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Executive  Summary 

In  the  second  half  of  the  20th  century,  the  United  States  enjoyed  stature  and  prosperity  at  levels 
seldom  achieved  in  recorded  history.  The  country’s  status  included  predominance  in  most  fields 
of  science  and  technology  (S&T),  as  well  as  a  phenomenal  breadth  and  pace  of  innovation.  We 
are  now  experiencing  a  global  shift  to  a  more  level  playing  field  among  nations;  demographics, 
economics,  and  political  forces  are  the  driving  forces  behind  this  shift.  The  impact  of  this  shift  on 
U.S.  S&T  will  be  significant.  By  the  middle  of  the  21st  century,  it  is  likely  that  a  number  of 
nations  will  be  similarly  prosperous  and  technologically  productive.  No  single  nation  or  group 
will  dominate  as  the  United  States  did  in  the  latter  half  of  the  1900s.  The  U.S.  share  of  the  global 
S&T  enterprise  will  decrease,  and  only  a  small  fraction  of  U.S.  scientists  and  engineers  (S&E) 
will  work  on  national  security  problems.  This  change  poses  challenges  to  the  roles  and  conduct 
of  Department  of  Defense  (DOD)  S&T.  In  particular,  DOD’s  ability  to  maintain  an  authoritative 
awareness  of  S&T  developments  around  the  world  will  become  increasingly  problematic. 

Most  attempts  to  quantify  these  challenges  utilize  simple  linear  or  exponential  extrapolations. 
Although  such  approaches  are  helpful  for  short-term  predictions,  they  tend  to  produce 
unrealistically  pessimistic  predictions  for  the  timescales  considered  in  this  paper.  The  present 
work  establishes  an  empirical  relationship  between  an  economy’s  gross  domestic  product  (GDP) 
per  capita  and  its  ability  to  generate  S&T  knowledge.  This  paper  then  employs  the  results  of  a 
full  economic  analysis  for  the  period  2005-2050  to  estimate  the  S&T  knowledge  production  for 
each  of  the  world’s  17  largest  economies. 

The  estimate  indicates  that  U.S.  share  of  S&T  productivity  will  decline  from  about  26  percent  in 
2005  to  18  percent  in  2050.  This  decline,  while  problematic,  is  not  unmanageable.  At  least 
through  2050,  the  United  States  will  remain  one  of  the  world’s  most  significant  contributors  to 
scientific  knowledge.  As  a  result,  the  U.S.  S&T  workforce  should  be  large  enough,  relative  to  the 
world  S&T  workforce,  to  remain  cognizant  of  S&T  developments  around  the  world — although 
the  means  of  doing  so  may  change.  This  ability  to  remain  cognizant  is  important  because  by 
2050,  countries  other  than  the  United  States  will  produce  most  scientific  knowledge.  Maintaining 
an  authoritative  awareness  of  S&T  around  the  world  will  be  essential  if  the  United  States  is  to 
remain  economically  and  militarily  competitive.  This  awareness  includes  the  ability  of  the  U.S. 
S&T  workforce  to  authoritatively  interpret  trends  in  global  S&T.  For  instance,  the  U.S.  S&T 
workforce  must  be  able  to  quickly  recognize  movements  in  the  frontiers  of  knowledge  and  the 
potential  for  new  military  applications  stemming  from  new  knowledge  or  a  combination  of 
existing  knowledge  and  new  technology.  The  required  awareness  can  be  maintained  only  if  the 
U.S.  S&T  workforce  is  a  participant  in  the  global  S&T  community.  This  is  true  for  the  DOD 
S&T  workforce  as  well. 

For  DOD  to  succeed,  it  will  be  necessary  to  find  a  means  to  tap  the  knowledge  of  the  larger  U.S. 
S&T  community  regarding  global  S&T.  It  is  only  at  this  level  that  the  United  States  will  have  a 
sufficient  number  of  S&T  “brain  cells”  to  actually  know  what  is  occurring  in  the  world  of  global 
S&T,  what  is  important,  and  what  is  not  important.  Tapping  this  knowledge  will  be  very 
challenging  for  DOD.  Nevertheless,  we  must  ensure  the  global  S&T  knowledge  held  by  the 
larger  U.S.  S&T  community  is  available  to  the  military  and  that  DOD  has  the  internal  capability 
to  comprehend  and  exploit  this  knowledge  through  the  DOD  S&T  workforce.  The  term  “DOD 
S&T  workforce”  refers  to  those  S&Es  who  are  funded  by  DOD  S&T  dollars  that  fall  into  the 
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categories  of  Basic  Research  (6.1)  and  Exploratory  Development  (6.2).  This  workforce  is  larger 
than  the  DOD  federal  S&T  workforce  (often  called  the  in-house  workforce),  which,  of  course, 
has  a  special  role.  Some  members  of  the  DOD  S&T  workforce  will  be  employees  of  DOD; 
others  will  be  involved  through  vehicles  such  as  contracts,  advisory  committees,  and  cooperative 
programs  with  other  government  agencies. 

Because  national  defense  is  among  the  highest  of  the  Government’s  responsibilities,  it  is 
essential  that  the  S&T  workforce  supporting  the  national  defense  mission  includes  some  of  the 
nation’s  foremost  S&Es.  The  people  best  able  to  maintain  authoritative  awareness  of  progress  in 
S&T  are  those  contributing  to  that  progress.  Such  individuals  must  form  the  core  of  the  DOD 
S&T  workforce.  A  subset  of  this  workforce  should  also  have  an  awareness  of  potential  military 
applications.  This  awareness  involves  a  working  knowledge  of  national  security  issues  and 
general  military  concepts  of  operations  (CONOPS)  or  concepts  of  use  (CONUSE)  in  order  to 
understand  how  something  new  might  be  useful  or  could  become  disruptive. 

The  largest  U.S.  window  on  the  world  of  global  S&T  is  its  national  S&T  workforce.  This 
workforce,  however,  spends  most  of  its  time  not  thinking  about  national  defense.  A  properly 
designed  DOD  S&T  workforce  is  the  best  conduit  to  the  knowledge  held  by  the  U.S.  national 
S&T  community.  The  DOD  S&T  workforce  should  be  sized  and  positioned  to  most  effectively 
accomplish  this  task.  In  simple  tenns,  the  DOD  S&T  workforce  must  be  plugged  into  the 
national  S&T  community  broadly  (and  to  the  extent  possible  into  the  global  S&T  community). 
To  accomplish  this,  the  DOD  in-house  S&T  workforce  must  be  widely  recognized  for  its 
contributions  to  the  nation’s  S&T  program.  In  other  words,  the  DOD  S&T  workforce  must  be 
“card-carrying”  members  of  the  larger  S&T  community.  This  recognition  is  paramount  because 
the  total  number  of  DOD  in-house  S&T  researchers  will  not  increase  in  proportion  to  the  growth 
of  the  global  S&T  enterprise.  Federal  employment,  compensation,  and  facility  initiatives  may  be 
necessary  to  attract  and  retain  the  necessary  talents  to  achieve  these  ends.  DOD  should  establish 
organizational  imperatives  to  prioritize  and  support  authoritative  global  S&T  awareness 
activities. 

External  researchers  from  academia,  other  government  agencies,  and  industry  must  complement 
the  DOD  in-house  S&T  workforce.  These  individuals  must  also  be  card-carrying  members  of  the 
global  S&T  community.  They  must  be  selected  and  funded  by  federal  program  managers  who 
themselves  are  (or  were)  card-carrying  members  of  the  S&T  community  and  who  possess  a  keen 
awareness  of  the  needs  of  the  military.  An  effort  should  be  made  to  establish  a  bond  between 
external  researchers  and  DOD  to  extend  the  reach  and  effectiveness  of  the  DOD  S&T  awareness 
network.  Indeed,  while  external  researchers  are  likely  to  be  funded  by  other  sources  as  well,  a 
bond  with  DOD  will  yield  better  awareness  functions  for  DOD.  These  bonds  become  a  means  for 
attracting  highly  qualified  individuals  to  DOD  employment.  Furthennore,  these  bonds  can  enable 
DOD  to  better  mobilize  sectors  of  the  larger  S&T  community  in  times  of  acute  and  pressing  need 
and  have  a  knowledge  base  suitable  to  preparation  for  the  war  after  next. 

To  make  the  most  effective  use  of  the  DOD  S&T  workforce,  it  will  be  necessary  to  employ 
emerging  tools  for  technology  forecasting  (TF)  and  data  mining.  These  tools  should  be  made 
available  at  the  desktop  of  all  DOD  S&Es  engaged  in  the  awareness  function.  The  tools  should 
access  the  widest  possible  databases  of  technical  reports  across  the  United  States  and,  with 
suitable  security  and  IP  protections,  should  include  information  from  all  research  proposals 
submitted  to  all  U.S.  agencies. 


2 


To  accomplish  the  objectives  outlined  above,  the  competition  between  the  need  to  control  S&T 
information  and  the  need  for  open  S&T  communications  must  be  managed  in  the  transition  to 
2050  and  beyond.  Policies  and  procedures  for  information  control  should  be  reevaluated  to 
determine  a  strategic  balance  between  the  risks,  costs,  and  benefits  of  S&T  information  control 
in  a  2050  context. 

Even  if  the  DOD  S&T  community  is  reinvigorated  as  suggested  above,  the  problems  confronting 
DOD  as  a  result  of  S&T  globalization  will  be  formidable.  DOD  will  not  have  the  fiscal  resources 
to  buy  its  way  out  of  these  problems  by  funding  its  own  standalone  program  that  is  large  enough 
to  maintain  insight  into  the  global  S&T  program  or  to  play  “catch  up”  to  a  foreign  effort  that  has 
gotten  ahead.  Some  nonmonetary  means  must  be  found  to  motivate  the  national  S&T  community 
to  accept  some  responsibility  for  keeping  DOD  aware  of  global  S&T  developments  that  could 
have  significant  national  defense  implications.  In  this  regard,  most  of  the  U.S.  national  S&T 
workforce  of  2050  is  yet  to  be  educated.  Perhaps  the  education  system  is  where  the  motivation 
should  be  developed  as  part  of  the  effort  to  imbue  students  with  an  understanding  of  their 
profession’s  civic  responsibilities.  A  concern  for  the  health  of  national  defense  should  be  among 
those  civic  responsibilities.  It  may  be  that  an  acceptance  of  this  civic  responsibility  among  the 
national  S&T  community  is  essential  for  the  solution  of  the  DOD  global  S&T  awareness 
problem. 
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1.  INTRODUCTION 


In  the  second  half  of  the  20th  century,  the  United  States  enjoyed  stature  and  prosperity  at  levels 
seldom  achieved  in  recorded  history.  The  country’s  status  included  predominance  in  most  fields 
of  science  and  technology  (S&T),  as  well  as  a  phenomenal  breadth  and  pace  of  innovation.  We 
are  now  experiencing  a  global  shift  to  a  more  level  playing  field  among  nations;  demographics, 
economics,  and  political  forces  are  the  driving  forces  behind  this  shift.  The  impact  of  this  shift  on 
U.S.  S&T  will  be  significant. 

The  globalization  of  S&T  has  been  a  topic  of  discussion  for  some  time.  Some  of  the  discussion 
has  related  to  its  impact  on  U.S.  competitiveness  and  often  argues  to  increase  the  supply  of 
scientists  and  engineers  (S&E)  and  increase  funding  for  the  scientific  enterprise.1 2  Other 
discussion  has  focused  on  how  globalization  is  changing  how  S&T  occurs  and  often  addresses 
the  need  to  prepare  scientists,  engineers,  and  societies  for  these  changes." 

By  the  middle  of  the  21st  century,  it  is  likely  that  a  number  of  nations  will  be  similarly 
prosperous  and  as  technologically  productive  as  the  United  States,  and  no  single  nation  or  group 
will  dominate  as  the  United  States  did  in  the  latter  half  of  the  1900s.  During  the  period  of  U.S. 
dominance,  nearly  half  of  the  S&Es  performing  research  in  the  world  were  in  the  United  States. 
Furthermore,  a  substantial  fraction  of  these  S&Es  were  working  on  research  for  national  security 
and  funded  by  the  Department  of  Defense  (DOD).  By  2050  this  situation  will  have  changed 
dramatically.  The  U.S.  share  of  the  global  S&T  enterprise  will  have  decreased,  and  only  a  small 
fraction  of  U.S.  S&Es  will  work  on  national  security  problems.  This  change  poses  challenges  to 
the  roles  and  conduct  of  DOD  S&T.  Before  addressing  these  challenges,  it  is  helpful  to  attempt 
to  quantify  the  magnitude  of  the  shift  underway  and  the  likely  timeframe  over  which  it  will 
occur. 


1  Rising  Above  the  Gathering  Storm:  Energizing  and  Employing  America  for  a  Brighter  Economic  Future ,  National 
Research  Council  (NRC)  Report  (2007);  see  http://www.nap.edu/openbook.php7record  id=11463&page=l. 

2  Knowledge,  Networks,  and  Nations:  Global  Scientific  Collaboration  in  the  21st  Century,  The  Royal  Society 
(2011);  see  http://rovalsociety.org/uploadedFiles/Roval  Society  Content/Influencing  Policy/Reports/20 1 1-03-28- 
Knowledge-networks-nations.pdf. 
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2.  THE  CHANGING  CONTEXT  FOR  U.S.  AND  DOD  S&T 


Economically  advanced  and  developing  countries  have  widely  recognized  that  S&T  is  a  key 
driver  in  the  world  economy  and  in  military  affairs.  Most  countries  now  have  stated  objectives  to 
invest  2  percent  to  4  percent  of  their  gross  domestic  product  (GDP)  into  research  and 
development  (R&D).  For  decades  the  United  States  has  been  the  predominant  force  in  the 
application  of  S&T  to  economic  and  military  advancement  through  an  average  investment  of 
about  2.5  percent  of  GDP  into  R&D.  At  present,  the  United  States  has  the  largest  GDP  of  any 
single  county  and  accounts  for  about  23  percent  of  the  world  GDP.3 4  However,  the  U.S.  fraction 
of  world  GDP  is  expected  to  decline  over  the  coming  decades.5 6 7 8  Since  it  is  unlikely  that  the 
United  States  will  markedly  increase  its  R&D  investment  as  a  percentage  of  its  GDP,  it  follows 
that  U.S.  investment  in  R&D  will  decline  as  a  percentage  of  the  world  investment  in  R&D.  This 
anticipated  decline  has  led  to  much  speculation  about  the  United  States’  ability  to  maintain  a 
dominant  position  in  S&T.  ’  It  would  be  helpful  if  one  could  estimate  the  magnitude  of  this 
expected  decline  for  the  coming  decades. 

The  following  section  provides  a  rough  estimate  of  the  likely  evolution  of  the  U.S.  position  in 
S&T  through  2050.  We  consider  S&T  to  be  the  subset  of  R&D  that  deals  with  basic  research 
(e.g.,  DOD  funding  category  6.1)  and  exploratory  development  (e.g.,  DOD  funding  category 
6.2).  This  is  often  referred  to  as  the  “Tech  Base,”  but  in  this  paper  it  will  be  referred  to  as  S&T. 
There  is  no  “first  principles”  methodology  available  to  make  the  desired  estimate  of  the  future 
U.S.  position.  However,  it  seems  reasonable  to  assume  that  an  economy’s  ability  to  reach  its  full 
potential  for  the  generation  of  S&T  knowledge  is  related  to  that  economy’s  standard  of  living. 
An  economy  with  a  low  standard  of  living  is  unable  to  support  the  infrastructure  needed  to  reach 
its  full  potential.  This  situation  will  change  as  the  economy  becomes  more  advanced.  When  the 
standard  of  living  becomes  typical  of  an  advanced  economy,  then  that  economy’s  ability  to 
generate  S&T  knowledge  should  become  typical  of  advanced  economies.  In  this  regard,  the  most 
often  used  metric  for  an  economy’s  standard  of  living  is  the  GDP  per  capita.  Although  this 
metric  has  many  limitations,  it  does  provide  a  means  by  which  to  compare  standards  of  living  in 
an  average  sense.  That  comparison  should  be  adequate  for  the  predictions  needed  in  this  paper. 

Because  the  United  States  has  the  largest  economy  of  the  economically  advanced  countries,  we 
will  consider  it  to  be  typical  of  an  advanced  economy  and  will,  therefore,  provide  comparisons 
relative  to  the  United  States.  In  this  regard,  it  should  be  noted  that  financial  comparisons  among 
countries  are  often  performed  using  market  exchange  rate  (MER)  comparisons  or  purchasing 
power  parity  (PPP)  comparisons.  The  comparison  method  chosen  can  lead  to  different  results. 
However,  the  two  rates  are  usually  quite  similar  among  economically  advanced  countries.  As  an 
example  of  GDP  per  capita  comparisons  among  advanced  economies  and  emerging  economies, 


3  OECD  Science,  Technology’,  and  Industry’  Outlook  2010;  see  http://www.keepeek.com/Digital-Asset- 
Management/oecd/science-and-technologv/oecd-science-technologv-and-industry-outlook-2010  sti  outlook-20 10- 

en. 

4  CIA  Fact  Book;  see  https://www.cia.gov/library/publications/the-world-factbook/. 

5  ERS/USDA  Data:  International  Macroeconomic  Data  Set;  see  http://www.ers.usda.gov/Data/Macroeconomics/. 

6  Rising  Above  the  Gathering  Storm:  Energizing  and  Employing  America  for  a  Brighter  Economic  Future  (2007). 

7  Knowledge,  Networks,  and  Nations:  Global  Scientific  Collaboration  in  the  21st  Century,  The  Royal  Society 
(2011). 

8  For  a  discussion  of  MER  and  PPP,  see  T.  Callen’s  “PPP  Versus  the  Market:  Which  Weight  Matters”;  see 
http://www.imf.org/extemal/pubs/ft/fandd/2007/03/basics.htm. 
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Figure  1  provides  a  historical  MER  comparison  of  GDP  per  capita  among  the  United  States, 
Organization  for  Economic  Cooperation  and  Development  (OECD)  nations,  Japan,  and  China. 
The  data  is  normalized  to  U.S.  GDP  per  capita. 


Year 

Figure  1.  GDP  per  Capita  for  OECD,  Japan,  and  China  (normalized  to  United  States)9 

As  shown  in  Figure  1,  although  there  is  some  GDP  per  capita  spread  among  the  advanced 
economies,  they  are  clustered  near  the  United  States.  The  emerging  economy  (China)  shows 
GDP  per  capita  that  is  markedly  less  than  that  which  is  typical  of  advanced  economies.  Based  on 
the  above  arguments,  we  expect  that  a  developing  economy  should  show  a  lower  per  capita  rate 
of  scientific  knowledge  generation  than  the  advanced  economies. 

It  would  be  helpful  to  know  whether  or  not  a  correlation  between  the  rate  of  scientific  knowledge 
generation  and  standard  of  living  as  measured  by  GDP  per  capita  actually  exists.  Although  there 
is  no  definitive  measure  of  S&T  knowledge  generation,  it  is  generally  accepted  that  S&T 
publications  and  patents  are  indicative  of  the  generation  of  S&T  knowledge.  We  therefore 
postulate  that  the  generation  of  scientific  publications  and  patents  is  a  surrogate  for  the 
generation  of  S&T  knowledge.  To  gain  some  insight  into  the  relationship  between  GDP  per 
capita  and  research  output,  Figure  2  displays  the  research  publication  output  per  million 
inhabitants  for  Japan,  China,  and  the  total  of  the  OECD  countries  measured  relative  to  the  United 
States  for  2008  (the  actual  U.S.  number  for  2008  was  about  900  research  publication  per  million 
inhabitants).  Also  included  in  Figure  2  is  the  GDP  per  capita  calculated  by  the  PPP  method  and 
the  MER  method  (both  normalized  to  the  United  States). 


9  OECD  Fact  Book  2010. 
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1.2  T 


US  OECD  Japan  China 

Figure  2.  Comparison  of  Publications  and  GDP  per  Capita  (normalized  to  United  States)10 

Figure  2  suggests  that  the  normalized  publication  output  correlates  with  the  normalized  GDP  per 
capita  and  that  the  PPP  method  of  calculating  the  GDP  per  capita  provides  a  slightly  better 
correlation  than  does  the  MER  method.  The  latter  point  may  be  peculiar  to  the  year  chosen  for 
comparison,  or  it  may  indicate  that  the  PPP  method  provides  a  better  measure  of  the  standard  of 
living  of  an  economy  and  that  the  standard  of  living  underlies  an  economy’s  ability  to  sustain  the 
infrastructure  needed  to  generate  S&T  knowledge. 

Regarding  patent  productivity,  Figure  3  displays  trilateral  patents* 11  per  million  population  for 
several  economically  advanced  countries  and  the  total  for  OECD  countries  normalized  to  the 
United  States  for  2007.  China  is  not  a  significant  player  in  the  trilateral  patent  arena  but  is 
included  for  comparison. 


10  OECD  Science,  Technology’,  and  Industry  Outlook  2010. 

11  Trilateral  Patent  Offices;  see  http://www.trilateral.net/about.html. 
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2.5 


Figure  3.  2007  Triplaterial  Patents  per  Million  Population  for  Several  Economically 
Advanced  Economies  (normalized  to  U.S.  patents  per  million  of  52. 6)12 


Figure  3  suggests  that,  within  a  factor  of  two,  economically  advanced  countries  produce  similar 
numbers  of  patents  per  inhabitant  and  emerging  economies  produce  substantially  fewer  patents 
per  inhabitant.  Unfortunately,  emerging  economies  are  not  yet  significant  players  in  the 
generation  of  trilateral  patents.  Hence,  a  meaningful  comparison  between  patent  productivity  and 
GDP  per  capita  is  not  available  for  those  economies.  It  is  expected,  however,  that  emerging 
economies,  as  they  become  more  advanced,  will  tend  toward  patent  productivity  similar  to  that 
of  economically  advanced  economies.  Here  again,  the  use  of  GDP  per  capita  normalized  to  the 
GDP  per  capita  of  economically  advanced  economies  should  provide  a  parameter  that  indicates 
an  economy’s  ability  to  produce  S&T  knowledge. 

If  one  accepts  that  research  publications  and  patents  are  a  reasonable  surrogate  for  scientific 
knowledge  generation,  then  Figures  2  and  3  suggest  that  the  rate  of  change  of  S&T  knowledge 
can  be  expressed  by  the  following  simple  differential  equation: 


dK 

dt 


rjP,  (1) 


where  K  represents  S&T  knowledge,  P  represents  an  economy’s  total  population,  and  //  is  an 
efficiency  factor  for  the  generation  of  S&T  knowledge.  The  efficiency  for  advanced  economies 
is  unlikely  to  vary  by  more  than  a  factor  of  two. 


If  we  focus  on  research  publications  and  assume  the  economy’s  S&T  efficiency  factor  scales 
linearly  with  GDP  per  capita,  then: 


r)  =  900 


GDP  /  capita 
USGDP  /  capita 


(2) 


12  OECD  Science,  Technology,  and  Industry’  Outlook  2010. 
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The  quantity  900  represents  a  number  typical  of  U.S.  research  publications  per  year  per  million 
inhabitants.  According  to  equations  1  and  2,  knowledge  of  an  economy’s  GDP  per  capita  relative 
to  U.S.  GDP  per  capita  allows  one  to  make  a  rough  estimate  of  that  economy’s  ability  to 
generate  scientific  knowledge.  The  viability  of  this  approach  is,  of  course,  based  on  the  empirical 
relationship  established  by  Figure  2. 

To  use  equation  2,  one  must  predict  the  GDP  per  capita.  Simple  linear  extrapolations  or  past 
growth  rates  are  often  used  to  make  such  predictions.  Unfortunately,  these  approaches  are 
helpful  only  for  short-term  predictions  but  are  not  valid  for  the  extended  period  considered  here. 
Predicting  GDP  per  capita  for  extended  periods  is  a  complex  undertaking  and  is  beyond  the 
scope  of  this  study.  A  proper  prediction  must  include,  among  other  things,  expected  exchange 
rate  dynamics,  long-term  demographic  trends,  education  trends,  and  investment  rates.  A  recent 

1  -5 

study  by  Hawksworth  and  Cookson  made  such  predictions  for  the  period  2005-2050.  This 
study  projected  the  size  of  the  17  largest  economies  in  the  world.  The  study  included  10 
advanced  economies  (United  States,  United  Kingdom,  Japan,  Germany,  France,  Italy,  Canada, 
Spain,  Australia,  and  South  Korea)  and  the  7  largest  emerging  economies  (China,  India,  Brazil, 
Russia,  Indonesia,  Mexico,  and  Turkey).  The  analysis  was  perfonned  using  both  market 
exchange  rates  and  purchasing  power  parity.  We  will  use  the  data  presented  by  Hawksworth  and 
Cookson  utilizing  PPP  rates.  Using  market  exchange  rates,  although  providing  quantitatively 
different  results,  does  not  change  the  basic  conclusions.  This  prediction  was  published  in  2006, 
yet  we  expect  the  relative  sizes  forecast  for  the  various  economies  will  likely  be  preserved  even 
though  the  timeframe  may  shift  slightly  as  a  result  of  the  “Great  Recession”  that  began  in  late 
2007.  As  long-term  economic  analyses  that  reflect  the  recession  become  available,  it  will  be 
straightforward  to  adjust  the  prediction  made  here. 

Figure  4  presents  the  results  for  the  predicted  GDP  per  capita  normalized  to  the  predicted  U.S. 
GDP  per  capita  and  using  PPP  rates  over  the  period  2005-2050. 


13  The  World  in  2050:  Beyond  the  BRICs — A  Broader  Look  at  Emerging  Market  Growth  Prospects,  Hawksworth 
and  Cookson,  PricewaterhouseCoopers  (2006);  see 

http://www.pwc.ch/user  content/editor/files/publ  tls/pwc  the  world  in  2050  e.pdf. 
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1.2 


-♦-US 
■  Canada 
—a—  UK 

Australia 
— *—  Japan 
— •—  France 
— i —  Germany 

- Italy 

Spain 
Korea 
Russia 
Mexico 
Brazil 
Turkey 
China 
Indonesia 
— —  India 


2000  2005  2010  2015  2020  2025  2030  2035  2040  2045  2050  2055 

Year 

Figure  4.  GDP  Per  Capita  (normalized  to  United  States  using  PPP  rates)14 

The  data  presented  here  result  from  a  simple  exponential  fit  to  the  data  presented  by  Hawksworth 
and  Cookson  for  2005  and  2050.  The  clear  separation  between  the  economically  advanced 
economies  and  the  emerging  economies  is  evident.  It  is  also  evident  that,  although  the  gap 
between  the  advanced  and  emerging  economies  narrows  significantly,  no  emerging  economy 
actually  enters  the  economically  advanced  category  by  2050. 

The  data  presented  in  Figure  4  and  equation  2  allow  one  to  estimate  the  annual  number  of 
research  publications  by  each  of  the  17  economies  studied  by  Hawksworth  and  Cookson  for  the 
period  2005-2050.  From  these  estimates,  one  can  calculate  the  fraction  of  the  total  number  of 
research  publications  contributed  by  each  of  the  17  economies  per  year.  Figure  5  presents  this 
information.  The  fraction  is  computed  relative  to  the  total  number  of  research  publications 
predicted  for  all  17  economies  considered. 


S  0.8 


14  Ibid. 
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Figure  5.  Estimated  Fraction  of  World  Research  Publications  for  17  Economies  Over  the 

Period  2005-2050 


According  to  the  predictions  shown  in  Figure  5,  by  2050  three  economies  (China,  India,  and  the 
United  States)  will  account  for  about  two-thirds  of  the  world’s  research  output. 

As  noted  above,  Figure  5  results  from  an  empirical  relationship  between  an  economy’s  GDP  per 
capita  and  its  scientific  productivity  and  is  based  on  a  particular  economic  analysis.  Its  utility 
derives  from  the  trends  and  timescales  that  it  identifies  rather  than  from  the  details  for  any 
particular  year.  It  is  the  trends  and  timescales  that  are  helpful  in  quantifying  the  changes  facing 
the  United  States.  Figure  5  suggests  that  the  U.S.  share  of  world  S&T  knowledge  production  will 
decline  from  about  26  percent  in  2005  to  18  percent  in  2050.  This  decline,  while  problematic,  is 
not  unmanageable.  At  least  through  2050,  the  United  States  will  remain  one  of  the  world’s  most 
significant  contributors  to  scientific  knowledge.  As  a  result,  the  U.S.  S&T  workforce  should  be 
large  enough,  relative  to  the  world  S&T  workforce,  to  remain  cognizant  of  S&T  developments 
around  the  world.  This  ability  to  remain  cognizant  is  important  because,  by  2050,  countries  other 
than  the  United  States  will  produce  most  scientific  knowledge.  Maintaining  an  authoritative 
awareness  of  S&T  around  the  world  will  be  essential  if  the  United  States  is  to  remain 
economically  and  militarily  competitive.  This  awareness  is  possible  only  if  the  U.S.  S&T 
workforce  is  a  participant  in  the  global  S&T  community.  This  is  true  for  the  DOD  S&T 
workforce  as  well.  In  this  regard,  the  DOD  workforce  will  face  several  issues.  Before  getting  into 
these  issues,  it  is  helpful  to  review  the  purpose  of  and  priorities  for  DOD  S&T. 
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3. 


PURPOSES  AND  PRIORITIES  OF  DOD  S&T 


To  frame  the  challenges  facing  DOD  S&T  as  a  result  of  globalization,  it  is  first  helpful  to  outline 
the  purposes  for  which  DOD  invests  in  S&T : 

•  Maintain  awareness  of  the  broad  global  S&T  program. 

•  Prepare  for  the  war  after  next. 

•  Invest  in  S&T  exploration. 

•  Discover  things. 

•  Invent  things. 

•  Position  DOD  to  be  able  to  mobilize  the  larger  S&T  community,  if  required. 

•  Find  out  early  what  will  not  work. 

•  Prepare  for  the  next  war  (e.g.,  support  acquisition  of  new  systems). 

•  Support  the  needs  of  existing  systems. 

These  items  are  not  necessarily  the  customary  or  official  reasons  for  DOD  S&T,  nor  are  they 
entirely  independent  of  one  another.  They  are,  however,  often  used  to  describe  the  DOD  S&T 
portfolio.  Most  of  these  activities  and  concepts  underlie  the  seminal  report  to  President  Truman 
from  Vannevar  Bush  in  1946,  which  framed  the  highly  successful  U.S.  S&T  strategy  for  nearly 
50  years.15  That  strategy  can  be  summarized  as  follows:  spend  as  much  as  you  can  gainfully 
invest  in  a  broad  range  of  topics  so  you  don’t  come  in  second  place  when  it  counts.  Overt 
military  relevance  was  a  secondary  consideration  and,  in  fact,  was  viewed  as  a  possible 
impediment  to  truly  basic  research  endeavors.  This  strategy  was  motivated  by  experience  in 
World  War  II  (WWII),  where  opponents  held  several  technical  forefronts  (e.g.,  precision-guided 
weapons,  jet  engines,  rocket  propulsion,  armor)  throughout  the  conflict.  It  was  only  through  the 
superior  numbers  and  the  industrial  might  of  the  Allies  that  WWII  ended  on  terms  favorable  to 
the  Allies.  This  strategy  also  served  the  Nation  well  throughout  the  Cold  War.  However,  it 
should  be  noted  that  evidence  suggests  this  strategy  may  be  unsustainable  in  the  21st  century  and 
that  relevance  or  societal  motivation  may  be  as  important  as  the  character  of  the  research  and 
should  be  a  factor  in  strategy  formulation. 16 

The  above  list  is  presented  in  priority  order,  in  the  authors’  opinion,  for  the  DOD  S&T  portfolio 
and  reflects  the  importance  of  the  research  and  its  relevance.  We  arrived  at  this  prioritization  in 
two  ways.  First,  the  upper  items  are  largely  in  the  competency  of  S&T  with  little  or  no  other 
providers  in  DOD;  the  lower  items  are  increasingly  found  in  the  core  competencies  of  other 
DOD  functions.  Second,  the  ability  to  fully  address  the  lower  items  often  depends  on  one  or 
more  skills  and  elements  of  knowledge  found  in  the  activities  of  the  upper  items.  The  following 
bullets  expand  on  these  purposes  and  introduce  the  likely  challenges  to  DOD  in  achieving  the 
various  purposes: 

•  Maintain  awareness  of  the  broad  global  S&T  program.  This  awareness  includes  the 
ability  of  the  U.S.  S&T  workforce  to  authoritatively  interpret  trends  in  global  S&T.  For 


15  Science  the  Endless  Frontier,  Vannevar  Bush  (1945);  see  http://www.nsf.gov/od/lpa/nsf50/vbushl945.htm. 

16  See,  for  example,  Pasteur’s  Quadrant:  Basic  Science  and  Technological  Innovation,  D.E.  Stokes,  Brookings 
Institution  Press  (1997). 
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instance,  the  U.S.  S&T  workforce  must  be  able  to  quickly  recognize  movements  in  the 
frontiers  of  knowledge  and  the  potential  for  new  military  applications  stemming  from 
new  knowledge  or  a  combination  of  existing  knowledge  and  new  technology  (i.e.,  avoid 
surprises  and  exploit  quickly).  A  recent  publication  characterized  S&T  as  involving  two 
major  phases:  prospecting  and  mining. 17  Prospecting  can  be  thought  of  as  an  activity  that 
is  important  in  the  long  term  but  shows  little  or  no  return  on  investment  in  the  short  term. 
Mining  begins  when  prospecting  has  progressed  to  the  point  where  sufficient 
understanding  has  been  gained  such  that  product  (or  system)  development  programs  can 
begin  using  traditional  return  on  investment  metrics. 18  To  maintain  awareness,  the  U.S. 
S&T  workforce  must  quickly  spot  the  movement  from  one  phase  to  another;  this  is 
possible  only  through  involvement  in  the  appropriate  prospecting  phases.  Spotting  this 
movement  was  relatively  easy  for  the  United  States  and  DOD  30  years  ago,  but  it  may  be 
more  challenging  now  as  the  largest  share  of  all  prospecting  advances  occurs  outside  of 
the  United  States.  A  simple  example  of  a  new  challenge  is  that  much  of  the  work  may  be 
reported  in  languages  other  than  English. 

•  Prepare  for  the  war  after  next.  In  many  ways,  this  is  where  DOD  S&T  has  a  key  role  to 
play.  The  activity  here  is  well  beyond  the  horizon  of  current  military  requirements,  and 
the  timescales  involved  are  typical  of  S&T  (e.g.,  10-20  years)  that  includes  a  prospecting 
phase.  This  activity  involves  developing  future  capabilities  scenarios,  alternatives,  and 
likelihoods  based  on  estimates  of  technology  trends  and  new  knowledge  gains  foreseen  in 
the  research  and  exploitation  pipelines.  It  plays  an  important  part  in  determining  areas  for 
S&T  investments,  motivating  discovery  and  invention,  and  involving  the  larger  S&T 
community  so  it  is  prepared  to  contribute  to  the  required  efforts  when  needed.  Playing  in 
this  area  requires  highly  talented  and  respected  S&Es.  A  growing  challenge  here  is 
attracting  such  individuals  to  participate  when  most  S&T  is  being  done  outside  of  DOD. 

•  Invest  in  S&T  exploration.  The  U.S.  Government,  including  DOD,  has  a  strong  record  of 
investing  in  research  at  the  frontiers  of  S&T  (prospecting)  to  foster  the  discovery  of  new 
knowledge.  DOD  is  unusual  with  regard  to  federal  funding  of  S&T  efforts  in  that  it  may 
also  be  the  user  of  the  results  of  its  S&T  efforts.  Numerous  examples  of  this  scenario  are 
found  in  military  systems  (e.g.,  radar,  sonar,  missiles,  aircraft).  One  cannot  expect  other 
sources  (e.g.,  industry)  to  invest  significantly  here,  and  studies  indicate  this  is 
increasingly  the  purview  of  governments  as  industry  looks  to  early  returns  on  its  R&D 
investments.19  Many  use  the  term  “curiosity-driven”  to  describe  this  activity,  but 
“knowledge-driven”  seems  more  appropriate  to  the  actual  motivations  of  both  the 
researchers  and  the  sponsors.  In  an  era  of  much  broader  global  S&T,  the  U.S.  share  of 
exploration  will  be  less.  This  presents  the  nation  and  especially  DOD  with  a  dilemma:  the 
reduced  share  suggests  a  narrowing  of  topics  in  which  S&T  investments  are  made,  but 
the  mission  requires  that  awareness  cover  all  areas  of  the  global  S&T  program. 

Resolution  of  this  dilemma  may  require  new  approaches  for  investing  in  S&T. 

•  Discover  things.  An  S&T  portfolio  ranging  from  exploration  to  application-driven 
investments  is  barren  without  frequent  successes  in  the  nature  of  discovery.  Successes 


17  The  S&T  Innovation  Conundrum,  T.  Coffey,  J.  Dahlburg,  and  E.  Zimet,  National  Defense  University  (NDU) 
Defense  &  Technology  Paper  Number  17  (2005). 

18  Avoiding  Technology’  Surprise  for  Tomorrow’s  Warfighter:  A  Symposium  Report,  NRC  (2009). 

19  OECD  Science,  Technology,  and  Industry  Outlook  2010. 
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can  be  large  or  incremental  advances  and  may  not  fully  coincide  with  the  original 
expectation  of  the  research.  These  are  the  characteristics  of  the  S&T  enterprise  and 
should  be  acknowledged  and  fostered  explicitly.  S&T  prospecting  activities  that  lead  to 
mining  coincide  with  a  discovery  in  some  cases,  but  not  always.  Discovery  success  rates 
for  a  given  portfolio  size  will  be  influenced  by  the  quality,  efficiency,  and  connectivity  of 
the  S&T  workforce,  but  otherwise  the  nature  of  discovery  will  not  change  in  a  more 
global  S&T  enterprise. 

•  Invent  things.  One  can  consider  a  discovery  with  clear  and  compelling  application(s)  as 
an  invention.  However,  invention  does  not  necessarily  involve  a  discovery.  It  may,  for 
example,  involve  the  realization  that  a  certain  combination  of  well-known  technologies 
provides  a  novel  capability.  Much  of  the  material  in  the  previous  bullet  is  equally  valid 
here,  and,  again,  the  basic  nature  of  invention  will  not  change  in  the  coming  decades. 

•  Position  DOD  to  be  able  to  mobilize  the  larger  S&T  community.  The  mobilization  of  the 
S&T  community  was  complete  in  WWII,  and  the  desire  to  retain  that  ability  was  an  aim 
of  Vannevar  Bush’s  report  to  Truman.  During  the  Cold  War,  large  S&T  investments 
preconditioned  the  U.S.  ability  to  mobilize  segments  of  the  research  community  when 
new  capabilities  were  sought  (e.g.,  the  space  race)  or  new  threats  emerged  (e.g.,  strategic 
deterrence).  One  could  argue  that  an  attempt  to  mobilize  a  very  willing  research 
community  post- 9/1 1  was  not  very  successful  because  limited  institutional 
preconditioning  existed  for  a  response  to  terrorism.  Such  broad  preconditioning  for 
national  security  will  be  even  more  problematic  in  30  years  when  DOD  is  a  smaller 
fraction  of  the  U.S.  S&T  investment  and  the  United  States  is  one  of  a  half-dozen  similar 
players  globally.  It  seems  a  new  approach  must  be  developed  to  accomplish  this  purpose. 
One  consideration  could  be  to  develop  more  efficient  and  rapid  means  of  mobilization 
involving  coordination  across  U.S.  agencies  engaged  with  the  non-DOD  S&T 
community.  Such  a  means  for  broad  mobilization  would  be  useful  outside  the  DOD 
mission  area  as  well  (e.g.,  homeland  security,  environmental  crises). 

•  Find  out  early  what  will  not  work.  This  important  S&T  purpose  is  often  overlooked, 
risking  large  system  engineering  overruns  and  procurement  delays.  An  important  role  of 
S&T  is  providing  a  sanity  check  on  the  promises  and  claims  of  new  system  concepts,  as 
well  as  the  maturity  of  component  technologies  for  incorporation  into  a  system,  to  enable 
DOD  to  be  a  “smart  buyer.”  This  role  demands  authoritative,  trusted,  and  objective  S&T 
expertise  at  a  very  early  stage  in  areas  where  new  concepts  are  being  proposed.  Trusted 
agents  should  not  have  vested  interests  (pro  or  con)  regarding  the  new  concepts.  Such  a 
role  is  unchanged  when  DOD  is  a  smaller  player  in  the  global  S&T  enterprise.  A  problem 
that  arises,  however,  is  sufficient  access  to  a  cadre  of  trusted  S&Es  who  have  the  required 
technical  authority  and  breadth  but  do  not  have  some  conflict  of  interest. 

•  Prepare  for  the  next  war.  This  purpose  primarily  involves  acquiring  new  military 
systems  for  delivery  in  5  or  more  years  against  known,  defined  requirements.  Early  on, 
the  S&T  role  is  largely  proof-of-concept  and  prototyping  in  relevant  environments. 
Thereafter,  the  component  technologies  are — or  should  be — well  known,  and  the  S&T 
role  involves  mostly  minor  (“spiral”)  upgrades  and  risk  reduction  activities.  In  terms  of 
Technology  Readiness  Levels  (TRL),  this  purpose  is  in  the  range  of  TRL  4  to  6  and 


20  Science  the  Endless  Frontier,  Vannevar  Bush  (1945). 
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generally  beyond  the  S&T  portfolio.  These  activities  should  scale  to  the  magnitude  of 
system  procurement  activities  provided  sufficient  U.S.  expertise  is  available. 

•  Support  the  needs  of  existing  systems.  Systematic  upgrades  to  existing  major  systems,  as 
well  as  quick  fixes  and  one-off  supplements  to  large  capabilities,  can  be  a  role  of  mature 
S&T.  One  can  argue  that  this  activity  has  grown  in  recent  years  because  existing  systems 
could  not  accurately  plan  for  the  war  after  next.  That  said,  the  functions  here  are  unlikely 
to  differ  much  from  today  versus  2030  and  beyond. 

In  summary,  Table  1  assesses  our  nine  reasons  for  DOD  S&T  investments.  We  indicate  by  red, 
yellow,  or  green  our  assessment  of  the  challenge(s)  to  DOD  in  achieving  that  purpose  in  2030 
and  beyond.  Green  means  the  current  practices  are  likely  to  suffice,  and  red  indicates  that 
challenges  to  these  purposes  are  significant.  Yellow  is  used  to  highlight  purposes  that  could  be 
constrained  by  relevant  S&T  expertise  available  to  DOD  or  related  challenges.  Further,  we 
indicate  whether  DOD  S&T  must  take  a  lead  for  each  purpose  or  whether  it  can  rely  on  the  lead 
of  others  in  DOD  or  elsewhere. 


Table  1.  Priorities  for  DOD  S&T 


Topic 

Most  Important 
(i.e.,  DOD  S&T 
must  lead  for  itself) 

Important 

(i.e.,  DOD  S&T  must 
participate  but  can  rely  on 
others  to  lead) 

X 

X 

Invest  in  S&T  exploration 

X 

Discover  things 

X 

Invent  things 

X 

X 

Find  out  early  what  will  not 
work 

X 

Prepare  for  the  next  war 

X 

Support  the  needs  of  existing 

systems 

X 

DOD’s  ability  to  maintain  authoritative  S&T  awareness  is  key  to  sustaining  success  overall.  This 
ability  faces  great  challenges  in  2030  and  beyond.  Only  DOD  can  maintain  S&T  awareness  for 
its  own  aims.  Therefore,  we  focus  on  this  subject  in  the  remainder  of  this  report. 
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4.  MANAGING  THE  TRANSITION  TO  2030  AND  BEYOND 

The  United  States  has  been  the  dominant  force  in  S&T  since  WWII.  It  is  clear,  however,  that  this 
dominance  is  being  replaced  by  a  situation  that  is  better  described  as  a  shared  participation  in  the 
generation  of  S&T  knowledge.  In  the  near  term,  as  a  result  of  its  large  investment  in  S&T 
infrastructure  and  the  high  impact  of  U.S. -produced  S&T  knowledge,  the  United  States  will 
maintain  its  leading  position  in  spite  of  the  rapid  growth  of  global  S&T.  We  will  maintain  this 
position  largely  because  it  takes  decades  to  put  in  place  a  S&T  engine  comparable  to  that 
currently  available  to  the  United  States.  In  the  long  term,  however,  U.S.  dominance  must  decline. 
This  is  simply  a  matter  of  numbers.  The  emerging  economies  will  grow  much  faster  than  the 
United  States’  economy. 

As  the  emerging  economies  become  more  advanced,  they  will  be  increasingly  able  to  invest  in 
S&T  and  have  established  goals  to  do  so.“  They  will  learn  from  U.S.  experience  and  improve  on 
it.  If  the  world  remains  stable  (e.g.,  no  major  wars,  no  cataclysmic  natural  disasters),  over  the 
next  50  years  the  largest  emerging  economies  will  surpass  the  U.S.  economy  in  size  and  will  be 
positioned  to  invest  larger  sums  in  S&T  than  the  United  States.  This  realization  has  caused 
concern  in  many  quarters.  It  is  difficult  to  accept  that  the  United  States  will  not  be  the  dominant 
force  in  S&T  for  much  longer  since  we  have  never  known  anything  else.  It  is  important, 
however,  that  the  United  States  develop  a  realistic  and  pragmatic  approach  to  this  transition. 
Doing  so  will  be  essential  to  obtaining  an  authoritative  S&T  understanding  to  properly  evaluate 
developments  so  the  Nation  can  remain  militarily  and  economically  competitive  as  technology 
evolves.  Failure  to  do  so  will  likely  have  significant  negative  outcomes  for  U.S.  economic 
competitiveness  and  national  security.  Perhaps  the  first  thing  to  understand  is  that  the  United 
States  is  in  no  imminent  danger  of  being  eclipsed  in  S&T  and  it  can  remain  a  major  force  in  S&T 
through  the  21st  century.  For  this  to  happen,  though,  the  United  States  will  need  to  achieve 
balance  among  legitimate  but  often  competing  demands.  Some  early  indications  in  this  regard 
are  troubling.  This  section  discusses  some  of  the  challenges  and  competing  demands  and  offers 
suggestions  on  how  to  proceed  while  we  are  in  transition  to  the  new  global  S&T  mix. 

Although  the  situation  for  the  United  States  at  large  seems  manageable,  the  situation  for  DOD 
seems  more  problematic.  Coffey  has  discussed  the  reason  for  this,  ~  which  derives  from  the  fact 
that  the  DOD  in-house  S&T  workforce  has  declined  much  more  rapidly  than  has  the  U.S.  S&T 
workforce  relative  to  the  global  S&T  workforce.  This  decline  is  likely  to  continue  at  some  level 
even  if  current  trends  improve. 

The  issue  confronting  DOD  is  that  of  putting  in  place  the  necessary  S&T  workforce  and  properly 
empowering  that  workforce.  This  task  can  be  daunting  to  even  visualize.  We  offer  a  simple 
visualization  in  Figure  6  in  which  the  areas  of  the  segments  are  representative  of  size.  The 
numbers  shown  are  our  simple  estimates  and  are  intended  only  to  give  some  sense  of  the  scale  of 
the  problem.  It  is  helpful  to  consider  the  problem  as  a  series  of  layers.  Layer  1,  or  bottom  layer, 
is  the  global  S&T  community  over  which  awareness  is  needed.  Layer  2  is  the  U.S.  S&T 
community,  which,  collectively,  should  have  a  good  understanding  of  what  is  happening  in  the 
global  community.  Layer  3  consists  of  the  nongovernment  S&T  community  that  is  bonded 


21  S&T  Strategies  of  Six  Countries — Implications  for  the  United  States,  NRC  Report  (2010). 

22  Building  the  S&E  Workforce  for  2040:  Challenges  Facing  the  Department  of  Defense,  T.  Coffey,  NDU  Defense 
&  Technology  Paper  Number  49  (2008). 
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(through  contract,  past  association,  etc.)  in  some  way  with  DOD.  Layer  4  consists  of  the  in-house 
S&Es  who  are  DOD  employees  funded  by  S&T  dollars.  Strictly  speaking,  Layers  3  and  4  are 
also  members  of  Layer  2,  which  itself  is  a  member  of  Layer  1 .  The  number  of  in-house  DOD 
S&Ts  and  the  nongovernment  S&Ts  bonded  to  DOD  generally  track  the  size  of  the  DOD 
program.  Because  the  DOD  program,  on  average,  has  been  constant  for  decades,  we  assume  this 
will  continue.  We  have,  therefore,  kept  the  size  of  Layers  3  and  4  at  the  present  values.  One 
could  add  many  additional  components  (e.g.,  S&Es  of  Allies),  but  for  conceptual  purposes  the 
four  layers  should  suffice. 


Total  DOD  S&T  Workforce 


-c 


B 


DOD  inhouse  S&T  Workforce 
(est  ~  15K  in  2050) 

-“Bonded”  extramural  researchers 
(est  ~  15K  in  2050) 


US  S&Es  doing  S&T  lest  ~  2M1 


Figure  6.  Visualization  of  Global  S&T  Workforce  in  Layers  for  2050  According  to  Authors’ 
Estimates  of  Population  in  the  Four  Components  or  Layers 


This  visualization  makes  the  challenges  quite  apparent.  First,  the  number  of  members  in  each 
layer  decreases  dramatically  from  Layer  1  to  Layer  4,  as  indicated  by  the  area  of  each  layer 
(about  10  million  globally  in  Layer  1  to  about  15,000  in  DOD  in  Layer  4).  Clearly,  our  largest 
window  on  the  world  of  global  S&T  is  our  national  S&T  workforce.  This  workforce,  however, 
spends  most  of  its  time  not  thinking  about  national  defense.  Gaining  access  to  defense-relevant 
knowledge  resident  in  the  U.S.  national  S&T  workforce  will  be  a  significant  challenge  for  DOD. 


It  is  instructive  to  briefly  compare  the  situation  depicted  in  Figure  6  to  the  era  when  the  United 
States  dominated  the  global  S&T  enterprise.  In  this  era,  the  United  States  was  about  one-half  of 
Layer  1  and  the  DOD  in-house  S&T  workforce  was  about  one -tenth  of  the  U.S.  S&T  workforce. 
In  that  era,  a  single  DOD  federal  S&T  worker  was,  on  average,  outnumbered  globally  about 
20:1.  By  2050,  that  ratio  will  have  increased  to  about  800:1.  The  numerical  consequences  are 
clear.  In  the  future,  each  DOD  S&E  will  have  significantly  more  colleagues  to  track  globally  and 
domestically  to  maintain  awareness  of  S&T  developments.  This  scenario  has  major  implications 
in  regard  to  the  DOD  S&T  workforce.  It  certainly  suggests  that  the  quality  of  each  DOD  federal 
S&E  must  be  high  and  that  efforts  must  be  undertaken  to  improve  connectivity  between  the 
DOD  S&T  workforce  and  national  S&T  workforce. 
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The  Federal  Government  only  has  a  few  avenues  available  to  improve  this  situation: 

•  Within  budgetary  constraints,  properly  size  and  empower  the  DOD  in-house  S&T 
workforce  so  it  represents  the  best  of  the  national  S&T  workforce  in  S&T  areas  of  long¬ 
term  interest  to  DOD. 

•  Improve  coordination  and  dependencies  among  the  DOD  in-house  S&T  workforce  and 
the  in-house  S&T  workforce  employed  by  other  government  agencies. 

•  Within  budgetary  constraints,  manage  a  contract  research  and  technology  portfolio  that 
provides  stable  funding  and  connects  a  segment  of  the  national  S&T  community  to  DOD. 

•  In  the  education  curriculum  for  S&Es,  include  studies  that  focus  on  the  civic 
responsibilities  S&Es  have  for  the  national  well-being,  including  matters  of  national 
defense. 

•  Make  optimum  use  of  TF  and  data  mining  techniques  by  the  DOD  S&T  workforce  in  the 
quest  for  authoritative  global  S&T  awareness. 

•  Balance  the  competition  regarding  the  need  to  control  S&T  information  and  the  need  for 
open  exchange  of  S&T  knowledge. 

The  following  sub-sections  will  provide  a  brief  discussion  of  several  of  the  above  topics. 

4.1  The  DOD  S&T  Workforce 

Because  the  national  defense  is  among  the  highest  of  the  Government’s  responsibilities,  it  is 
essential  that  the  S&T  workforce  supporting  that  mission  represent  the  nation’s  best  S&Es.  In 
this  regard,  the  rules  for  participation  in  the  S&T  community  are  well  understood  and 
immutable:  one  is  either  a  player  or  not  player — there  is  no  middle  ground.  The  people  best  able 
to  maintain  awareness  of  progress  in  S&T  are  those  contributing  to  that  S&T  progress.  Such 
individuals  must  fonn  the  core  of  the  DOD  S&T  workforce.  A  subset  of  this  workforce  should 
also  have  an  awareness  of  potential  military  applications,  which  involves  familiarity  with 
national  security  issues  and  general  military  CONOPS  or  CONUSE  to  understand  how 
something  new  might  be  useful  or  could  become  disruptive. 

An  essential  component  of  the  DOD  S&T  workforce  is  the  federal  or  in-house  component.  This 
workforce  plays  an  important  role  in  advancing  defense-related  S&T,  connecting  DOD  to  the 
larger  S&T  community,  identifying  important  S&T  developments,  and  advocating  the 
exploitation  of  those  developments.  To  most  effectively  accomplish  these  responsibilities,  the  in- 
house  workforce  must  be  widely  recognized  as  card-carrying  members  of  the  larger  S&T 
community.  This  recognition  is  paramount  to  achieving  awareness  because  the  total  number  of 
DOD  in-house  S&T  researchers  will  not  increase  in  proportion  to  the  growth  of  the  global  S&T 
enterprise.  DOD  must  be  able  to  hire  from  among  the  nation’s  best  S&Es.  Doing  so  may  require 
hiring,  employment,  and  compensation  initiatives,  as  well  as  organizational  imperatives  to 
prioritize  and  support  S&T  awareness  activities.  The  U.S.  Government  has  employed  similar 
recruiting  initiatives  in  the  past  to  meet  shortages  in  certain  fields,  but  these  must  focus  on  and  be 
tailored  to  DOD’s  in-house  S&T  workforce  and  the  activities  associated  with  awareness.  In  that 
sense,  it  is  not  primarily  a  financial  compensation  issue — although  certain  thresholds  are 
probably  required.  It  is  really  about  creating  a  working  environment  that  attracts  the  best  and 
then  fosters  their  achievement  and  global  recognition.  Being  a  DOD  in-house  S&E  should  be 
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widely  seen  as  performing  important,  challenging,  and  satisfying  work.  Much  of  the  DOD’s  in- 
house  S&T  is  performed  by  the  three  service  corporate  laboratories  (Air  Force  Research 
Laboratory  [AFRL],  Army  Research  Laboratory  [ARL],  Naval  Research  Laboratory  [NRL]). 
These  laboratories  should  have  a  special  responsibility  for  maintaining  S&T  awareness. 
Therefore,  there  is  great  merit  in  focusing  the  in-house  component  of  the  S&T  workforce  in  the 
three  DOD  corporate  laboratories  so  the  proper  culture  can  be  nourished  and  critical  masses  of 
card-carrying  members  in  many  disciplines  can  be  achieved. 

While  it  is  unnecessary  to  grow  the  in-house  S&T  workforce  in  pace  with  the  international  S&T 
workforce,  it  is  nevertheless  advisable  (within  budgetary  constraints)  to  grow  this  workforce. 
Coffey  has  pointed  out  that  the  defense  workforce  has  not  kept  pace  with  the  national  S&T 
workforce  regarding  developing  areas  of  S&T.2'  This  is  worrisome.  It  will  be  necessary  for  the 
in-house  workforce  to  maintain  expertise  in  traditional  defense  areas.  However,  entirely  new 
areas  of  S&T  will  emerge  by  2050  that  will  be  important  to  DOD.  It  is  essential  that  the  DOD  in- 
house  S&T  workforce  have  expertise  in  these  emerging  areas.  It  is  recommended  that  the  DOD 
in-house  S&T  workforce  be  doubled  over  the  next  30  years  to  track  these  developments  while 
simultaneously  maintaining  expertise  in  the  traditional  areas.  This  growth  should  be  used  to 
establish  expertise  in  the  emerging  areas.  The  resulting  2050  in-house  S&T  workforce  of  about 
30,000  S&Es  would  then  represent  about  25  percent  of  the  expected  total  DOD  S&E  workforce 
in  2050. 

External  researchers  from  academia  and  industry  must  complement  the  in-house  component  of 
the  DOD  S&T  workforce.  These  individuals  must  also  be  card-carrying  members  of  the  global 
S&T  community.  They  must  be  managed  and  funded  by  federal  program  managers  who 
themselves  are  (or  were)  card-carrying  members  of  the  S&T  community  and  who  possess  a  keen 
awareness  of  military  needs.  An  effort  should  be  made  to  establish  a  bond  between  external 
researchers  and  DOD  and  its  S&T  aims  to  extend  the  reach  and  effectiveness  of  the  DOD  S&T 
awareness  network.  Indeed,  while  external  researchers  are  likely  to  be  funded  by  other  sources  as 
well,  their  bond  with  DOD  will  yield  better  awareness  functions  for  DOD.  These  bonds  become 
a  means  for  attracting  highly  qualified  individuals  to  DOD  employment.  Furthermore,  external 
researchers  can  enable  DOD  to  better  mobilize  sectors  of  the  larger  S&T  community  in  times  of 
acute  and  pressing  needs  and  give  DOD  a  knowledge  base  suitable  to  prepare  for  the  war  after 
next. 

Although  DOD  cannot  and  should  not  guarantee  funding  to  any  component  (in-house  or  not)  of 
the  S&T  community,  it  should  embrace  the  concept  of  a  DOD  S&T  community  and  work  to 
facilitate  interaction  and  cooperation  within  this  community.  It  is  the  impression  of  the  authors 
that  such  a  relationship  existed  between  a  subset  of  the  national  S&T  community  and  DOD  for 
several  decades  after  WWII.  This  post-WWII  arrangement,  as  typified  by  the  early  Office  of 
Naval  Research  (ONR),  was  very  effective  in  advancing  DOD  S&T  interests.  Unfortunately,  the 
early  bonds  that  were  established  were  substantially  weakened  as  DOD  became  a  lesser  player  in 
the  national  S&T  program  and  as  the  concept  of  a  DOD  S&T  community  slipped  away.  It  would 
be  helpful,  in  addressing  the  globalization  of  S&T,  to  create  a  21st  century  analog  of  the  post- 
WWII  DOD  S&T  community. 


23  NDU  Defense  &  Technology  Paper  Number  49  (2008). 
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An  impediment  to  accomplishing  the  above  is  a  tendency  that  has  emerged  over  the  past  two 
decades  to  force  federal  agencies  to  compete  in  the  marketplace  along  with  ah  other  performers 
for  ah  or  much  of  their  funding  support.  This  competition  is  usually  counterproductive  because, 
among  other  things,  it  compromises  the  “honest  broker”  function  of  the  federal  S&Es  and  causes 
the  nongovernment  workforce  to  view  the  in-house  workforce  as  competitors,  thereby  impeding 
knowledge  sharing  within  the  larger  S&T  community.  This  is  not  conducive  to  building 
necessary  partnerships  and  bonding.  The  tendency  is  also  puzzling  in  that  the  in-house 
government  workforce  is  one  of  the  few  areas  remaining  where  government  agencies  can  make 
truly  strategic  decisions,  such  as  maintaining  long-tenn  competence  in  particular  areas  and 
undertaking  high-risk  projects  that  are  not  ready  for  competitive  procurements. 

Within  the  Government,  the  most  successful  S&T  performing  organizations  are  those  where  the 
sponsors  enter  a  long-range  strategic  relationship  with  the  federal  S&T  perfonning  organization 
and  hold  that  organization  to  a  high  standard  of  performance.  Federal  S&T  performing 
organizations  that  operate  according  to  this  approach  are  among  the  most  productive  in  the 
Government  and  compare  very  favorably  with  nonfederal  S&T  perfonning  organizations  when 
the  standard  metrics  used  to  judge  such  organizations  are  applied.  The  federal  S&T  performing 
organizations  must  value  these  metrics  and  make  them  a  priority  while  providing  state-of-the-art 
supporting  labs  and  facilities  to  these  ends.  In  this  case,  the  S&Es  within  the  organization  are 
empowered  to  become  and  remain  card-carrying  members  of  the  S&T  community  through  a 
culture  that  rewards  the  researchers  for  focusing  on  S&T  and  its  frontiers.  To  the  extent  that 
these  individuals  are  among  the  leaders  and  best  researchers  in  the  held,  the  job  of  awareness  is 
easier  and  will  naturally  reach  further.  It  is  simply  a  matter  of  how  many  people  will  call  the 
DOD  S&E  with  new  Endings  versus  the  DOD  individual  contacting  an  increasing  number  of 
dispersed  researchers  to  learn  of  new  results.  Having  a  workforce  of  uniformly  high-quality 
S&Es  will  also  increase  rates  of  discovery  and  invention,  which  can  only  further  DOD’s 
awareness.  It  ultimately  comes  down  to  interactions  among  subject  matter  experts  on  a  global 
scale.  One  must  encourage  these  interactions,  leam  from  them,  and  plan  from  them.  This  was 
achieved  when  the  United  States  dominated  global  S&T  and  national  security  was  a  primary 
motivation  and  major  sponsor.  In  this  regard,  it  is  worth  noting  again  that  today’s  technical 
dominance  by  the  U.S.  military  was  established  in  that  timeframe  and  in  that  context. 

Even  if  the  DOD  S&T  community  is  reinvigorated,  the  problems  confronting  DOD  as  a  result  of 
S&T  globalization  will  be  formidable.  DOD  will  not  have  the  fiscal  resources  to  buy  its  way  out 
of  the  problem.  Some  nonmonetary  means  must  be  found  to  motivate  the  national  S&T 
community  to  accept  some  responsibility  for  keeping  DOD  aware  of  global  S&T  developments 
that  could  have  significant  national  defense  implications.  In  this  regard,  most  of  the  U.S.  national 
S&T  workforce  of  2050  is  yet  to  be  educated.  Perhaps  the  education  system  is  where  the 
motivation  should  be  developed  as  part  of  efforts  to  imbue  students  with  an  understanding  of 
their  profession’s  civic  responsibilities.  A  concern  for  the  health  of  national  defense  should  be 
among  those  civic  responsibilities.  It  may  be  that  an  acceptance  of  this  civic  responsibility 
among  the  national  S&T  community  is  essential  to  solving  the  DOD  S&T  awareness  problem. 

4.2  DOD  S&T  Programmatics  and  Portfolio  Methods 

It  seems  clear  that  the  size  of  the  DOD  S&T  program  will  suffer  a  continuous  decline  between 
now  and  2050  relative  to  the  global  S&T  program.  This  scenario  requires  a  programmatic 
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strategy  regarding  the  details  of  the  DOD  S&T  program.  A  research  portfolio  with  fewer 
resources  is  typically  enhanced  by  focusing  attention  in  certain  areas  perceived  to  be  of  long- 
tenn  future  DOD  impact.  Important  areas  will  include  those  that  have  always  been  of 
particular,  perhaps  unique,  DOD  interest,  as  well  as  emergent  S&T  areas  and  so-called 

OS 

“convergent”  areas  at  the  intersection  of  more  traditional  S&T  subject  areas.'  It  is  probably  wise 
to  err  on  the  side  of  inclusion  rather  than  to  miss  an  area  that  will  grow  in  importance.  It  will  be 
necessary  to  distribute  the  mix  of  in-house  and  external  brains  cells  in  some  optimal  way  across  a 
map  of  the  S&T  portfolio  of  investments.  The  need  to  focus  limited  resources  poses  a  dilemma 
to  achieving  broad  awareness.  Given  limited  resources,  one  can  make  an  argument  for 
employing  contract  research  or  limited  investments  in  areas  where  the  long-tenn  interest  is  yet  to 
be  established  and  reserving  in-house  people  and  programs  for  more  persistent  topics  and 
emerging  areas  where  DOD  importance  has  been  established.  One  must  approach  this  carefully, 
however,  or  it  will  result  in  an  in-house  S&T  workforce  that  is  not  well  matched  to  emerging 
S&T  that  will  become  essential  to  DOD.  All  of  this  must  occur  in  the  context  of  the  larger  U.S. 
S&T  portfolio.  Means  must  be  devised  to  better  link  those  other  activities  to  the  national  security 
mission  and  DOD  brain  cells.  The  judgments  and  balances  needed  to  accomplish  the  above  will 
be  especially  challenging  and  should  be  subject  to  careful  scrutiny  and  evaluation. 

DOD  solicitations  for  new  research  should  be  as  broad  as  possible  to  create  an  inventory  of 
proposals  that  is  larger  than  will  be  funded.  The  external  funding  vehicle  of  choice  should  retain 
as  much  simplicity  and  flexibility  in  execution  as  possible.  The  proposal  process  should  be 
highly  interactive  with  constant  feedback  to  foster  convergence  of  ideas  with  the  highest  priority 
DOD  areas  of  interest.  Further,  solicitations  should  focus  on  S&T  content  with  only  passing 
reference  to  military  applications  and  use.  These  details  can  come  later  when  the  ideas  are  on  the 
table.  Broad  solicitations  allow  DOD  to  monitor  new  ideas  and  potential  movements  in  frontiers 
of  knowledge  and  applications  beyond  those  that  DOD  ultimately  funds.  In  this  way,  the 
portfolio  will  evolve. 

If  DOD  would  like  to  see  proposals  and  ideas  from  the  global  enterprise  to  improve  awareness,  it 
should  engage  globally  by  presence  and  funding,  or  the  global  enterprise  will  not  submit  such 
proposals  in  the  long  run.  All  DOD  S&T  agencies  maintain  a  global  presence  and  become 
involved  in  joint  programs  with  other  nations  and  agencies.  This  has  been  productive  in  the  past, 
but  the  need  for  these  activities  will  increase  and  should  be  an  explicit  component  of  the  DOD 
S&T  portfolio — a  nonn  rather  than  a  marginal  activity.  The  desired  norm  is  discussed  briefly  in 
the  next  section. 

4.3  Interagency  and  International  Activities 

Even  when  the  above  is  accomplished,  it  seems  very  likely  that  an  expansion  of  the  combined 
DOD  federal  S&T  workforce  plus  the  DOD-bonded  members  of  the  larger  S&T  workforce  will 
be  desirable  as  a  result  of  the  massive  growth  expected  in  global  S&T.  This  expansion  could  be 
accomplished  by  encouraging  and  expanding  joint  S&T  programs  involving  the  federal  S&Es  of 
other  U.S.  agencies.  While  joint  programs  may  involve  some  compromise  in  the  specific  goals  of 
the  original  DOD  investment,  the  gains  from  broader  awareness  and  increased  S&T  outputs  are 


24  Quadrennial  Defense  Review’  (QDR  2010),  pp.  94-95;  see  http://www.defense.gov/qdr/. 

25  2025  Technology’  Intersections  Study,  MITRE  Technical  Report,  September  2007. 
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likely  to  outweigh  those  reductions."  ’  ’  ’  The  2050  context  will  likely  benefit  from  far  more 
such  joint  programs.  While  their  primary  aim  is  improved  global  S&T  awareness,  joint  programs 
with  other  U.S.  agencies  will  also  enable  DOD  to  be  in  a  position  to  better  mobilize  broader 
sectors  of  the  S&T  community  in  times  of  special  needs. 

Similar  comments  apply  regarding  DOD  and  U.S.  agency  overseas  S&T  presence.  An  increased 
global  presence  seems  intuitively  wise  for  2030  and  beyond,  but  an  effective  one  may  require 
careful  study  and  adaptation.  The  character  of  the  current  activities  may  need  to  change  in  view 
of  the  relative  shift  in  the  global  U.S.  and  DOD  positions  from  30  years  ago  (when  most  of  these 
global  outposts  were  established)  to  the  context  of  2030  and  beyond. 

4.4  Technology  Forecasting  and  Data  Mining 

The  ability  to  effectively  manage  the  DOD  S&T  investment  portfolio  in  the  face  of  much  larger 
U.S.  and  global  investments  will  require  access  to  technology  forecasts  and  technology  data 
mining  of  worldwide  S&T  activities.  Also,  with  a  decreasing  DOD  share  of  the  global  count  of 
S&Es  doing  S&T,  the  DOD  S&Es  can  enhance  their  individual  awareness  by  similar  access.  The 
specific  tools  for  each  purpose — portfolio  management  or  awareness — may  differ  slightly  but 
must  be  congruent  and  widely  available  to  the  users.  We  briefly  discuss  these  tools,  their 
features,  and  potential  uses  in  this  section  and  provide  further  details  in  Appendix  A. 

The  activities  termed  “technology  foresight”  have  largely  sought  to  forecast  the  direction  of  S&T 
together  with  economic  forces  that  enable  new  developments  to  reach  the  commercial 
marketplace.  In  this  sense,  technology  foresight  becomes  a  futures  forecast  of  particular  interest 
to  economic  investors  and  policymakers.  Often,  it  requires  predicting  one  or  more  innovations 
from  the  advancing  frontiers  of  science  and/or  technology,  as  well  as  the  necessary 
manufacturing  methods.  It  may  include  concepts  for  novel  marketing  strategies  to  achieve 
widespread  successful  implementation  in  society.  Of  course,  it  is  an  inexact  forecast  for  both 
technical  and  market  reasons.  For  the  purposes  of  DOD  S&T  awareness,  we  are  less  interested  in 
forecasting  arrival  in  the  marketplace  than  in  tracking  movements  at  the  frontiers  of  S&T  and 
then  rapidly  assessing  their  potential  impact  on  national  security — either  in  terms  of  new 
opportunities  or  new  threats — whether  or  not  commercial  market  potential  exists.  It  is  also 
important  for  DOD  to  understand  market  forces  that  could  yield  commodity  pricing  for  needed 
capabilities,  as  well  as  new  threats  that  might  stem  from  the  intersections  of  inexpensive 
widespread  availability  of  a  technology  and  result  in  unintended  consequences. 

However,  DOD’s  need  for  global  awareness  of  knowledge  frontier  movements  is  much  more 
detailed  and  nuanced  than  the  customary  products  of  futures  forecasting.  Scientific  frontiers  can 
be  moving  in  important  and  subtle  ways  well  in  advance  (e.g.,  decades)  of  rapid  progress  and 


26  International  Science  and  Engineering  Partnerships:  A  Priority >  for  U.S.  Foreign  Policy  and  Our  Nation ’s 
Innovation  Enterprise  (NSB-08-4,  2008). 

21  Best  Practices  for  Increasing  the  Impact  of  Research  Investments,  Report  by  Ocean  Research  Advisory  Panel  of 
National  Oceanographic  Partnership  Program  (July  2007). 

2S  Army  R&D  Collaboration  and  the  Role  of  Globalization  in  Research,  J.  Lyons,  NDU  Defense  &  Technology 
Paper  Number  5 1  (2008). 

29  Globalization  of  Science  and  Engineering  Research — A  Companion  to  S&E  Indicators  2010,  National  Science 
Board  (NSB)  (2010);  see  http://www.nsf.gov/nsb/publications/index.isp. 
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wide  recognition. l0'  31  This  is  the  prospecting  phase  of  S&T  that  can  lead  to  later,  more  evident, 
and  rapid  mining  activities32  and  is  the  primary  reason  for  having  subject  matter  experts  in  DOD 
who  are  among  the  global  S&Es  working  at  the  frontiers.  These  experts  are  properly  placed  and 
equipped  to  interpret  the  early  events. 

A  subset  of  futures  or  technology  foresight  of  more  interest  to  DOD  is  often  termed  “technology 
forecasting,”  or  TF,  as  described  further  in  Appendix  A.  The  aim  of  TF  is  to  shape  the  DOD 
S&T  investment  portfolio  over  time.  We  briefly  consider  this  portfolio  in  three  main  parts: 

1 .  S&T  areas  of  enduring  and  perhaps  unique  importance  to  DOD 

2.  Subjects  identified  as  emerging  S&T  of  potential  and  special  relevance  to  DOD 

3.  Future  investment  topics  of  high  potential  for  DOD  relevance  and  little  investment  by 
others,  as  yet,  where  knowledge  frontiers  could  move  quickly. 

In  all  cases,  DOD  must  understand  which  S&T  areas  other  sponsors  may  cover  and  make  results 
available  to  DOD  so  its  investments  can  be  more  focused  to  meet  DOD  needs.  DOD  must 
arrange  its  S&T  portfolio  to  meet  all  three  parts  for  investing  S&T  funds  as  described  earlier. 
Doing  so  requires  a  strategy  for  employing  the  DOD  S&T  workforce.  The  various  components 
of  that  workforce  will  have  different  focuses  regarding  the  three  parts  of  the  portfolio.  For 
example,  the  in-house  component  has  a  responsibility  across  all  three  parts.  There  are  about 
15,000  in-house  S&Es  funded  by  S&T  dollars.  Of  these,  about  5,000  work  in  the  three  corporate 
laboratories.  Because  the  corporate  laboratories  are  best  positioned  to  remain  current  on 
emerging  S&T,  it  is  logical  that  they  should  have  a  special  focus  on  parts  (2)  and  (3).  The 
remaining  10,000  in-house  S&Es  funded  by  S&T  dollars,  along  with  the  industrial  component, 
should  focus  on  parts  (1)  and  (2).  The  academic  component  should  focus  on  (3).  This  is  not  to 
imply  that  the  various  components  of  the  DOD  S&T  workforce  should  be  restricted  in  the  areas 
where  they  can  contribute.  Good  ideas  should  be  permitted  to  arise  from  any  component  of  the 
workforce.  Each  component  should,  however,  have  a  clear  focus  of  responsibility  and  activity. 
DOD  must  optimally  deploy  its  finite  number  of  S&E  assets  to  balance  the  competing  demands 
of  maintaining  DOD  S&T  output  and  broad  awareness.  Only  in  this  way  can  DOD  arrange  its 
portfolio  to  meet  all  nine  of  the  purposes  for  investing  S&T  described  earlier.  Global  S&T 
awareness  is  the  key  to  success  and  can  be  aided  through  data  mining,  as  discussed  in  the 
following  paragraphs. 

Performing  S&T  data  mining  to  understand  the  frontiers  of  knowledge  is  not  fundamentally  new. 
If  a  literature  review  at  the  beginning  of  a  research  project  is  considered  a  form  of  technical  data 
mining,  as  it  should  be,  then  researchers  have  been  data  mining  since  the  dawn  of  scientific 
inquiry.  It  is  useful  to  briefly  describe  the  timeless  process  of  literature  review  to  see  important 
elements  and  limitations.  A  review  starts  with  a  query  of  a  particular  topic  within,  for  example, 
the  scientific  literature.  From  this,  a  number  of  potentially  relevant  papers  emerge  that  the 
researcher  carefully  examines  for  content  and  for  the  list  of  referenced  authors  with  related  work. 
Most  researchers  then  pursue  other  closely  related  topics  suggested  by  paper’s  content  and 
search  for  other  publications  and  presentations  by  the  cited  authors  of  interest  hoping  for  more 
recent  and  relevant  “hits”  on  the  subject(s)  of  interest.  From  this  activity,  new  ideas  and  new 


30  NDU  Defense  &  Technology  Paper  Number  17  (2005). 

31  Science  and  Engineering  Indicators  2010 ,  NSB  (2010);  see  http://www.nsf.gov/nsb/publications/index.isp. 

32  NDU  Defense  &  Technology  Paper  Number  17  (2005). 
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collaborations  can  arise.  New  collaborations  are  critical  to  the  researcher  because  they  can  yield 
more  timely  awareness  of  advances  by  others  starting  even  at  the  idea  formulation  stage.  Such 
collaboration  is  only  likely  when  the  DOD  S&E  is  viewed  as  a  valuable  peer  to  the  other 
researcher  (i.e.,  card-carrying).  It  is  also  worth  noting  this  method’s  limits,  which  stem  from 
language  barriers  of  two  kinds:  (1)  the  result  of  an  actual  shift  in  the  written  language  of  the 
publication  and  (2)  the  missed  detection  of  a  relevant  development  in  another  field  because  it  has 
evolved  with  another  field-specific  tenninology  and  is  unrecognizable  from  the  seeker’s 
disciplinary  experience.  In  this  case,  emerging  semantic  methods  show  great  promise  provided 
the  first  disciplinary  cross-over  terminologies  and  concepts  have  occurred  in  the  database 
searched. 

What  has  changed  in  traditional  literature  review  as  a  technical  data  mining  method  is  the  means 
to  search  for  information  and  the  breadth  of  databases  available  to  search.  The  combination  of 
TF  with  technical  data  mining  has  been  a  very  active  area  for  more  than  a  decade  with  the  advent 
of  the  “information  age”  in  a  very  competitive  global  marketplace.  A  number  of  capable 
products  exist.  Several  are  described  in  detail  in  two  National  Research  Council  (NRC) 
reports.  ’  We  assume  these  tools  will  continue  to  improve  and  will  be  successful  as  long  as 
they  are  widely  available  to  the  DOD  S&E  research  community  engaged  in  the  S&T  awareness 
function.  They  must  also  be  easy  to  use  and  interpret.  Efforts  toward  the  latter  end  are  well 
underway.  In  a  simple  sense,  the  data  mining  methods  can  reveal  clusters  and  trends  of  activity 
by  subject  and/or  by  the  researchers  and  institutions  involved.  Linkages  between  clusters  and  the 
generation  of  new  clusters  can  be  particularly  enlightening.  We  note  that  searches  of  venture 
capital  databases  are  now  available  and  might  have  spotted  sooner  the  unanticipated  outcomes  of 
the  25-year  Army  S&T  Technology  Forecast  discussed  in  Appendix  A. 

Often,  data  mining  results  are  synthesized  into  a  diagram  in  the  form  of  a  network-like  sketch. 
We  give  an  example  of  such  an  output  in  Figure  7.  The  sketch  shown  was  done  by  Zhu  and 
Porter  in  2001  to  map  global  institutional  involvement  in  nanotechnology.  From  such  a  map, 
based  on  analysis  of  text  from  published  papers  and  reports,  it  is  possible  to  indicate  the  key 
subjects  associated  with  each  institution.  In  this  map,  the  size  of  each  node  represents  the 
publishing  activity  on  these  subjects  at  those  institutions,  and  the  indicated  links  show  the 
strongest  correlations  between  the  research  activities  of  the  various  institutions.  The  remaining 
notations  (e.g.,  the  ellipse)  are  used  to  give  a  three-dimensional  perspective  to  the  layout  of  the 
various  subjects  and  linkages.  More  elaborate  network  maps  are,  of  course,  possible. 


33  Persistent  Forecasting  of  Disruptive  Technologies,  NRC  Report  (2009);  see 
http://www.nap.edu/catalog.php7record  id=12557. 

34  Persistent  Forecasting  of  Disruptive  Technologies:  Report  2,  NRC  Report  (2010);  see 
http://www.nap.edu/catalog.php7record  id=12557. 

35  “Automated  extraction  and  visualization  of  information  for  technological  intelligence  and  forecasting,”  D.  Zhu 
and  A.L.  Porter,  Technical  Forecasting  and  Social  Change  69  (2002),  pp.  495-506. 
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Figure  7.  A  Schematic  of  Results  for  Data  Mining  by  Zhu  and  Porter 
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It  is  clear  that  waiting  for  the  literature  to  emerge  is  too  late.  For  S&T  awareness  at  the  frontiers 
of  new  knowledge,  the  challenges  become  the  timeliness  and  breadth  of  accessible  databases 
rather  than  the  tools  themselves.  We  focus  on  these  considerations  in  the  next  few  paragraphs. 


The  timeline  for  a  research  effort  extends  over  many  years,  and  the  presentation  or  publication  of 
results  occurs  several  years  after  the  initial  ideas  are  formed  and  the  research  begins.  Formal 
publication  may  be  preceded  somewhat  by  availability  of  early  results  on  the  Internet, 
particularly  the  so-called  “Deep  Web.”  Absent  immediate  awareness  from  collaboration  by 
DOD  S&Es  with  others,  the  next  best  opportunity  is  at  the  research  proposal  stage,  where  insight 
can  be  gained  several  years  before  new  ideas  and  initial  results  may  be  recorded  elsewhere. 
Obtaining  such  insights  becomes  possible  via  proposal  databases  through  technical  data  mining 
tools  and  activities.  The  breadth  of  access  should  be  across  all  U.S.  S&T  agencies,  at  the  least, 
and  internationally  to  the  extent  possible. 


It  becomes  apparent  that  the  most  desirable  database  to  search  at  this  stage  is  the  entire  record  of 
both  funded  and  declined  proposals.  Indeed,  this  is  the  information  base  held  by  experienced 
DOD  S&T  program  managers  and  by  any  DOD  researcher  who  is  engaged  in  the  proposal 
review  process  as  is  expected  for  a  card-carrying  member  of  the  community.  Typically,  this 
information  base  is  broader  than  just  the  set  of  proposals  to  DOD  because  participants  are 
individuals  who  are  frequently  involved  in  reviews  for  other  sponsors  both  across  and  beyond  the 
United  States.  Further  insight  into  emerging  S&T  developments  comes  from  automation  and 
technical  data  mining  tools  applied  to  the  entire  proposal  database.  This  search  introduces  a  very 
significant  issue  of  intellectual  property  rights  and  can  create  conflicts  of  interest.  Since  the  aim 


36  Ibid. 

37  Content  on  the  Internet  that  is  not  found  in  most  search  engine  results  because  it  is  stored  in  a  database  rather  than 
on  HTML  pages.  Viewing  such  content  is  accomplished  by  going  to  the  Web  site’s  search  page  and  typing  in 
specific  queries.  LexiBot  was  the  first  search  engine  to  make  individual  queries  to  each  searchable  database  that  it 
finds.  Also  known  as  the  “invisible  Web.” 
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is  basically  a  mapping  of  clusters  and  linkages  of  S&T  activities,  including  the  names  of 
researchers  engaged  in  them,  one  actually  does  not  need  the  technical  concepts  embodied  in  the 
proposal  at  first,  only  the  keywords,  the  author(s),  the  affiliation(s),  and  maybe  the  cited 
references.  This  would  be  sufficient  for  the  data  mining  mapping  and  should  not  involve 
proprietary  infonnation.  The  use  of  this  infonnation,  particularly  if  the  concepts  are  to  be 
explored  as  a  result  of  the  mapping,  will  have  to  be  controlled  to  limit  access  to  only  authorized 
users  (e.g.,  For  Official  Use  Only). 

This  broad  search  of  all  proposals  would  enable  early  identification  of  emerging  areas,  as  well  as 
the  beginnings  of  new  disciplinary  “cross-over”  or  convergence  areas,  even  before  any  funding. 
These  insights  would  provide  new  semantic  links  between  disciplines  much  sooner  than 
previously  possible;  these  links  could  then  be  applied  to  the  full  set  of  funded  research  databases 
before  the  new  areas  emerge  in  traditional  literature  sources.  A  data  mining  map  that  draws  upon 
this  data  is  also  an  excellent  means  to  track  progress  and  deviations  from  a  technology  forecast 
as  time  evolves  and  can  be  used  to  solicit  structured  inputs  from  subject  matter  expert  surveys  in, 
for  example,  the  Delphi  method  (see  Appendix  A).  The  insights  can  also  be  used  to  shape 
solicitations  for  new  research  proposals. 

Lastly,  the  ability  for  scanning  the  horizon  for  S&T  activities  will  be  an  increasing  challenge  to 
many  U.S.  agencies  and  missions  because  of  the  global  growth  of  the  enterprise  and  staffing 
constraints  in  many  agencies  and  federal  functions.  This  challenge  encourages  a  “whole  of 
government”  approach  to  technology  data  mining  activity. 

4.5  Control  of  Information 

A  competition  between  the  need  to  control  S&T  information  and  the  need  for  open  S&T 
communications  must  be  managed  in  the  transition  to  2050.  This  competition  occurs  at  all  levels. 
For  example,  basic  research  is  generally  characterized  as  a  culture  of  open  communication. 
However,  researchers  are  reluctant  to  release  the  results  of  their  research  until  they  are  in  a 
position  to  get  credit  (usually  through  a  publication).  At  the  same  time,  they  also  want  to  know 
what  other  researchers  in  their  field  are  doing  so  they  can  remain  current,  benefit  from  the  work 
of  others,  and  enhance  the  prospects  of  their  research.  To  accomplish  these  objectives, 
researchers  develop  a  strategy  that  involves  aspects  of  both  an  open  and  a  closed  system.  The 
situation  that  confronts  U.S.  S&T  (civilian  and  military)  is  very  similar. 

S&T  is  recognized  as  a  key  enabler  for  both  military  and  economic  competitiveness.  As  a  result, 
there  is  a  legitimate  interest  in  controlling  access  in  areas  where  one  has  a  competitive 
advantage.  This  interest  is  usually  addressed  through  security  classification  controls  or 
proprietary  information  controls.  On  the  other  hand,  one  wants  to  gain  infonnation  regarding  the 
competitive  advantages  of  others.  The  latter  interest  is  addressed  through  a  variety  of 
approaches,  such  as  military  espionage,  industrial  espionage,  and  routine  interaction  among  the 
S&Es  of  the  various  competitors.  As  with  all  such  undertakings,  the  quality  of  the  results  is 
determined  by  the  expertise  of  the  various  players  and  an  understanding  of  what  is  gained  and 
what  is  lost  by  playing  (or  not  playing). 


38  The  State  of  Scientific  and  Technical  and  Weapons  Intelligence  Analysis:  Survey  Findings,  K.  Hawker  et  al., 
MITRE  Report — For  Official  Use  Only  (2008)  (or  see  Studies  in  Intelligence  Vol.  52,  No.  2  [2008]). 
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S&T  is  moving  from  a  situation  where  the  United  States  was  the  principal  generator  of  scientific 
knowledge  to  one  where  most  scientific  knowledge  will  emerge  from  economies  other  than  the 
United  States.  It  will  become  increasingly  difficult  for  the  United  States  to  maintain  an 
authoritative  awareness  of  the  state  of  S&T.  A  related  development  is  that  private  companies  are 
becoming  increasingly  global  in  character  and  will  become  difficult  to  associate  with  a  particular 
nation.  However,  these  entities  may  gain  a  better  global  view  of  S&T  than  any  one  nation,  which 
could  either  help  or  hinder  the  matter  of  maintaining  an  authoritative  awareness  of  world  S&T. 

We  are  also  seeing  the  emergence  of  global  S&T  initiatives  (the  human  genome  project,  climate 
change,  Large  Hadron  Collider,  ITER,  etc.).  Furthermore,  the  impact  of  modern  IT  and  the 
evolution  of  a  new  communication  infrastructure  greatly  facilitate  global  collaboration  in  S&T 
(e.g.,  about  one-third  of  U.S.  scientific  publications  are  now  published  in  collaboration  with 
other  countries).  These  are  profound  changes,  and  we  are  only  at  the  beginning  of  the 
globalization  of  S&T.  Keeping  up  with  these  changes  will  be  challenging  for  the  United  States 
and  especially  for  DOD.  The  United  States  (including  DOD)  will  need  to  balance  the  benefits  of 
controlling  S&T  information  to  preserve  military  and  economic  advantages  with  the  benefits  of 
open  exchange  of  S&T  information  to  exploit  global  knowledge  for  U.S.  interests.  This  will  be  a 
nontrivial  and  dynamic  calculus.  As  with  most  balancing  acts,  leaning  too  far  in  one  direction 
will  have  a  negative  outcome. 

Most  nations  have  in  place  procedures  to  prevent  the  release  of  information  that  could  endanger 
their  national  or  economic  security.  In  the  area  of  national  security,  a  major  means  of  control  has 
been  the  security  classification  system.  The  U.S.  security  classification  system  is  very  well 
developed  and  has  three  basic  classification  levels:  Top  Secret,  Secret,  and  Confidential.  These 
categories  are  defined  in  Executive  Order  12356.  The  security  classification  system  applies  to 
S&T  information  that  has  been  derived  fully  or  in  part  from  federal  funding.  In  general,  it  has 
been  national  policy  that  fundamental  research  (as  defined  in  National  Security  Decision 
Directive  189)  funded  by  federal  funds  should,  to  the  maximum  extent  possible,  be  unrestricted. 
There  are,  of  course,  procedures  for  classifying  a  fundamental  research  program  in  the  event  it  is 
deemed  necessary  (e.g.,  Executive  Orders  12958  and  13292). 

A  fourth  category,  referred  to  as  Sensitive  But  Unclassified  (SBU),  is  often  invoked.  This 
category  has  no  statuary  definition  and  has  been  the  subject  of  considerable  debate  over  the  past 
years.  This  debate  became  especially  loud  after  9/11  when  steps  were  taken  to  attempt  to  deny 
terrorists  information  that  might  be  unclassified  but  helpful  to  their  cause.  Unlike  classified 
information,  which  generally  has  well-defined  classification  criteria,  the  SBU  category  is  often 
ambiguous  and  characterized  by  subjective  decisionmaking.  In  2006  the  Congressional  Research 
Service  prepared  a  report  on  this  matter  and  the  various  positions  and  options  associated  with 
it.  In  2008  the  White  House  issued  a  memorandum  for  the  heads  of  executive  departments  and 
agencies.  It  instituted  the  “Controlled  But  Unclassified  Information  [CBU])”  category  that 
incorporated  most  of  what  was  generally  placed  into  the  SBU  category.40  This  memorandum  was 
followed  by  the  establishment  of  the  Interagency  Taskforce  on  Controlled  but  Unclassified 


39  See  http://www.law.umarvland.edu/marshall/crsreports/crsdocuments/RL33303  02 1 52006.pdf. 

40  See  http://georgewbush-whitehouse.archives.gov/news/releases/2008/05/200805Q9-6.html. 
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Information.  On  August  25,  2009,  the  Task  Force  reported  its  findings.41  The  impact  of  the 
findings  was  not  clear  at  the  time  this  paper  was  published. 

The  private  sector  has  similar  procedures  for  preventing  the  undesired  release  of  S&T 
information.  These  procedures  generally  fall  under  the  categories  of  trade  secrets  and  proprietary 
information.  Both  the  national  security  and  private  sector  control  systems  involve  a  conscious 
tradeoff  among  the  costs  and  benefits  of  control.  For  example,  there  are  real  and  substantial 
direct  costs  associated  with  controlling  information.  One  must  put  in  place  an  infrastructure  for 
determining  and  codifying  the  rules  for  control  and  ensuring  the  rules  are  respected  and 
enforced.  De  facto  “opportunity  costs”  are  also  associated  with  the  control  of  S&T  information, 
such  as  the  loss  of  S&T  progress  and  gains  that  would  have  resulted  from  the  information’s 
release.  These  opportunity  costs  must  be  weighed  against  the  benefits  associated  with 
information  control,  which  include  delayed  progress  and  increased  costs  faced  by  other  nations 
in  the  development  of  armaments  and  competing  products.  A.S.  Quist  has  provided  a  more 
complete  discussion  of  the  benefits  and  risks  associated  with  information  control.42 

In  managing  the  transition  to  the  global  S&T  enterprise  of  2050,  the  balance  among  the  risks, 
costs,  and  benefits  of  controlling  information  will  also  shift.  Careful  and  changing  judgments 
will  have  to  be  made.  It  is  clear  that  the  choices  for  a  world  in  which  one  party  is  dominant  will 
differ  from  a  world  of  a  half-dozen  or  so  equal  players.  It  would  seem  unwise  to  take  positions 
now  that  we  would  rue  by  2050  when  the  United  States  will  be  looking  for  more  exchanges  and 
cooperation.  Perhaps,  as  a  consequence  of  9/11,  the  United  States  has  shifted — without  careful 
analysis  of  risks,  costs,  and  benefits — in  a  direction  that  will  not  serve  us  well  in  2050. 43 


41  See  http://www.dhs.gov/xlibrary/assets/cui  task  force  rpt.pdf. 

42  See  http://www.fas.org/sgp/library/quist2/index.html. 

43  Beyond  Fortress  America:  National  Security  Controls  on  Science  and  Technology’  in  a  Globalized  World,  NRC 
Report  (2009);  see  http://www.nap.edu/catalog.php7record  id=12557. 
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5.  CONCLUSIONS  AND  RECOMMENDATIONS 

The  authors  reached  the  following  conclusions: 

•  By  the  middle  of  the  21st  century,  the  U.S.  share  of  the  global  S&T  enterprise  will 
decrease,  and  only  a  small  fraction  of  U.S.  S&Es  will  work  on  national  security 
problems. 

•  The  U.S.  share  of  S&T  productivity  will  decline  from  about  26  percent  in  2005  to  about 
18  percent  in  2050. 

•  The  United  States  will  remain  one  of  the  world’s  most  significant  contributors  to 
scientific  knowledge,  and  the  U.S.  S&T  workforce  should  be  large  enough,  relative  to  the 
world  S&T  workforce,  to  remain  cognizant  of  S&T  developments  around  the  world.  The 
DOD  S&T  workforce  alone  will  not  be  large  enough,  and  maintaining  authoritative 
awareness  of  S&T  globally  will  be  among  DOD’s  greatest  challenges. 

•  Maintaining  an  authoritative  awareness  of  S&T  around  the  world  will  be  essential  if  the 
United  States  is  to  remain  economically  and  militarily  competitive.  The  required 
awareness  can  be  maintained  only  if  the  U.S.  S&T  workforce  is  a  participant  in  the  global 
S&T  community.  This  is  true  for  the  DOD  S&T  workforce  as  well. 

•  The  people  best  able  to  maintain  authoritative  awareness  of  progress  in  S&T  are  those 
contributing  to  that  S&T  progress.  Such  individuals  must  fonn  the  core  of  the  DOD  S&T 
workforce. 

•  It  will  be  necessary  to  find  means  to  tap  the  global  S&T  knowledge  that  the  national  U.S. 
S&T  community  will  have.  We  must  ensure  the  knowledge  of  global  S&T  held  by  the 
national  U.S.  S&T  community  is  available  to  the  military  and  that  DOD  has  the  internal 
capability  to  comprehend  and  exploit  this  knowledge  through  the  DOD  S&T  workforce. 

•  TF  and  data  mining  will  play  increasingly  important  roles  in  maintaining  global  S&T 
awareness. 

•  In  the  transition  to  2050  and  beyond,  DOD  must  wisely  manage  the  legitimate 
competition  between  the  need  to  control  S&T  information  and  the  need  for  open  S&T 
communications. 

•  Even  if  the  DOD  S&T  community  is  reinvigorated  as  suggested  in  this  paper,  the 
problems  confronting  DOD  as  a  result  of  S&T  globalization  will  be  formidable  and 
beyond  the  ability  of  DOD  alone.  Some  nonmonetary  means  must  be  found  to  motivate 
the  national  S&T  community  to  accept  some  responsibility  for  keeping  DOD  aware  of 
global  S&T  developments  that  could  have  significant  national  defense  implications. 
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The  authors  offer  the  following  recommendations: 

•  DOD  should  take  the  actions  necessary  to  ensure  the  DOD  S&T  workforce  is  plugged 
into  the  national  S&T  community  broadly  (and  to  the  extent  possible  into  the  global  S&T 
community).  To  accomplish  this,  the  DOD  must  build  a  DOD  S&T  workforce  (including 
an  in-house  S&T  workforce)  with  staff  who  are  widely  recognized  as  card-carrying 
members  of  the  larger  S&T  community. 

•  The  three  primary  DOD  corporate  research  laboratories  (AFRL,  ARL,  and  NRL)  should 
be  assigned  a  special  responsibility  for  maintaining  authoritative  awareness  of  and 
participating  in  emerging  S&T  believed  to  be  of  long-term  potential  importance  to  DOD. 

•  Coordination  among  DOD  and  U.S.  agencies  engaged  with  the  non-DOD  S&T 
community  must  increase.  The  objective  should  be  more  joint  programs  among  these 
agencies  to  help  connect  DOD  with  the  larger  S&T  community  and  vice  versa. 

•  The  DOD  S&T  community  should  be  utilized  to  authoritatively  interpret  the  data  that 
will  emerge  from  the  TF  and  data  mining  communities. 

•  Policies  and  procedures  for  information  control  should  be  reevaluated  to  detennine  a 
strategic  balance  between  the  risks,  costs,  and  benefits  of  S&T  information  control  in  a 
2050  context. 

•  DOD  should  work  with  various  professional  organizations  and  educational  institutions  to 
ensure  that  those  receiving  education  related  to  participation  in  the  future  national  S&T 
workforce  consider  the  health  of  national  defense  to  be  among  their  civic  responsibilities. 
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Appendix  A.  Technology  Forecasting 

We  view  technology  foresight  in  three  main  forms: 

1 .  Futures 

2.  Technology  forecasting  (TF) 

3.  Frontier  movements  in  science  and  technology  (S&T),  including  intersections  or 
convergences. 

In  some  sense,  “futures”  and  “technology  forecasting”  are  the  more  traditional  concepts,  and 
each  depends  on  those  listed  below  it.  Therefore,  both  of  the  traditional  activities  ultimately 
depend  on  the  third  concept — estimating  movements  in  the  S&T  knowledge  frontiers  in  some 
relevant  timeframe.  DOD’s  need  for  global  awareness  of  these  movements  of  knowledge 
frontiers  is  much  more  detailed  and  nuanced  than  the  traditional  activities  provide.  Some 
advances  may  have  no  relevance  to  DOD,  or  advancement  of  a  very  particular  feature  may  be 
particularly  relevant  and  yield  important  clues  about  future  capabilities.  Also,  scientific  frontiers 
often  move  in  important  and  subtle  ways  well  in  advance  (e.g.,  decades)  of  rapid  progress  and 
wide  recognition.  This  is  the  prospecting  phase  of  S&T  that  can  lead  to  later,  more  evident,  and 
rapid  mining  activities.44  Subject  matter  experts  in  DOD — who  are  among  the  global  scientists 
and  engineers  (S&E)  working  at  the  frontiers — are  essential  for  the  third  concept  to  succeed  for 
DOD.  These  experts  are  properly  placed  and  equipped  to  interpret  the  early  events. 

A  useful  definition  of  TF  is  given  in  the  recent  NRC  study  Persistent  Forecasting  of  Disruptive 
Technologies  45 ’  46  The  definition  expands  on  an  earlier  definition  in  Martino.47  The  NRC  study 
takes  TF  to  be  “the  prediction  of  the  invention,  timing,  characteristics,  dimensions,  performance, 
or  rate  of  diffusion  of  a  machine,  material,  technique,  or  process  serving  some  useful  purpose.” 
This  interpretation  also  highlights  that  TF  is  largely  about  events  after  there  has  been  movement 
in  the  frontiers  of  S&T  knowledge  when  the  “useful  purpose”  and  even  the  nature  (e.g., 
“machine,”  “material,”  or  other)  of  the  movement  are  more  fully  evident.  The  NRC  study  goes 
on  to  describe  TF  methodologies  in  four  general  categories: 

1 .  Judgmental  or  intuitive  methods 

2.  Extrapolation  and  trend  analysis 

3.  Models 

4.  Scenarios  and  simulation. 

Within  these  general  categories  are  many  individual  methods,  as  described  in  the  NRC  report. 
For  reference,  Table  A-l  is  reproduced  from  the  Handbook  of  Technology  Foresight,  which 
lists  the  33  common  methods  of  TF  in  columns  according  to  the  degree  of  judgment  or  intuition 
(e.g.,  “qualitative”  nature). 


44  NDU  Defense  &  Technology  Paper  Number  17  (2005). 

45  Persistent  Forecasting  of  Disruptive  Technologies  (2009);  see  http://www.nap.edu/catalog.php7record  id=12557. 
4,1  Persistent  Forecasting  of  Disruptive  Technologies:  Report  2  (2010);  see 
http://www.nap.edu/catalog.php7record  id=12557. 

47  “Recent  Developments  in  Technological  Forecasting,”  J.P.  Martino,  Climatic  Change  11,  pp.  211-235  (1987). 

48  The  Handbook  of  Technology  Foresight — Concepts  and  Practice,  L.  Georghiou  et  ah,  Edward  Elgar  Publishing 
(2008). 
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Table  A-1 .  Common  Methods  of  TF 


Qualitative 

Quantitative 

Semi-Quantitative 

1 .  Backcasting 

20.  Benchmarking 

26.  Cross-Impact/Structural 
Analysis 

2.  Brainstonning 

21.  Bibliometrics 

27.  Delphi 

3.  Citizens  Panels 

22.  Indicators/Time  Series 
Analysis 

28.  Key/Critical  Technologies 

4.  Conferences/Workshops 

23.  Modeling 

29.  Multi-Criteria  Analysis 

5.  Essays/Scenario  Writing 

24.  Patent  Analysis 

30.  Polling/Voting 

6.  Expert  Panels 

25.  Trend  Extrapolation/ 
Impact  Analysis 

3 1 .  Quantitative  Scenarios 

7.  Genius  Forecasting 

32.  Roadmapping 

8.  Interviews 

33.  Stakeholder  Analysis 

9.  Literature  Review 

10.  Morphological  Analysis 

1 1 .  Relevance  Trees/Logic 
Charts 

12.  Role  Playing/ Acting 

13.  Scanning 

14.  Scenario  Workshops 

15.  Science  Fictioning 

16.  Simulation  Gaming 

17.  Surveys 

18.  SWOT  Analysis 

19.  Weak  Signals/Wildcards 

Most  technology  forecasts  combine  several  of  these  methods  in  a  particular  study  to  achieve  a 
balance  among  the  strengths  and  weakness  of  a  particular  method.  The  TF  studies  can  be  also  be 
characterized49  as  projecting  from  today  in  an  orderly,  mostly  traceable,  fashion  or  leaping  to  a 
future  state  where  the  path  to  that  state  is  not  well  specified  (“continuous”  or  “discontinuous”). 
The  objective  of  the  study  can  characterize  it  as  “exploratory,”  wherein  the  aim  is  to  consider  the 
evolution  of  some  technology,  for  example,  and  then  decide  what  must  be  done  to  get  there;  or, 
the  study  can  be  termed  “nonnative,”  wherein  future  opportunities  or  threats  are  assessed  for  a 
forecasted  evolution  in  one  or  more  technologies,  for  example.  For  DOD  purposes,  both 
exploratory  and  nonnative  aspects  are  usually  combined  in  a  more  or  less  continuous  perspective 
on  the  future  evolution.  The  typical  timeframes  for  such  studies  in  DOD  fall  into  short  term 
(within  5  years),  medium  term  (5-10  years),  and  long  term.  The  nature  of  TF  also  shifts  with  the 
timeframe,  typically  going  from  exploratory  in  the  short  term  to  nonnative  in  the  long  term.  The 
occasional  longer  tenn  or  discontinuous  look  can  mitigate  risks  and  avoid  surprises  by 
subsequently  placing  a  few  “brain  cells”  in  the  areas  identified  as  outliers  in  these  results.  The 
notion  of  monitoring  outliers  to  a  consensus  view  can  be  formalized  using  the  Weak 
Signals/Wild  Cards  (#19)  method. 

The  typical  TF  approach  used  in  DOD  is  some  combination  of  the  following  methods: 


49  The  Handbook  of  Technology’  Foresight — Concepts  and  Practice  (2008). 
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•  Brainstorming  (#2) 

•  Conferences/Workshops  (#4) 

•  Expert  Panels  (#6) 

•  Key/Critical  Technologies  (#28). 

The  above  methods  are  used  together  with  elements  of  Weak  Signals/Wild  Cards  (#19),  Trend 
Extrapolation/Impact  Analysis  (#25),  or  Roadmapping  (#32)  in  varying  degrees.  Note  these  are 
mostly  qualitative  methods  that  rely  largely  on  individual  judgment  and  expert  intuition. 

There  are  numerous  examples  of  such  studies.  We  cite  a  report  that  examined  the  performance  of 
an  earlier  long-term  TF  for  Army  S&T50  and  then  made  recommendations  to  improve  the 
approach  by  considering  convergences  between  S&T  areas  and  use  of  Roadmapping  (#32)  and 
Stakeholder  Analysis  (#33)  TF  methods.  The  assessment  of  the  earlier  25-30-year  long-term 
forecast — made  15  years  later — showed  that  about  one-quarter  of  the  topics  (5)  were  right  on 
target,  another  quarter  (4)  underestimated  the  subsequent  pace  of  progress,  and  another  quarter 
(4)  lagged  the  forecast  progress.  Three  forecasted  topics  never  substantially  advanced  at  all,  and 
the  impacts  of  four  rapid  advances  were  missed  related  to  the  explosion  of  the  Internet,  IT,  and 
wireless  communication  applications  in  the  late  1990s.  One  could  argue  that  correctly  identifying 
about  three-fourths  of  the  topics,  incorrectly  estimating  the  pace  for  one-half  of  the  topics,  and 
getting  a  few  wrong  by  inclusion  and  a  few  by  omission  is  fairly  good  and  probably  in  the  nature 
of  such  forecasts.  It  suggests  that  a  revisit  of  any  such  long-tenn  forecast  every  5  years  or  so 
would  be  wise,  but  doing  so  more  often  may  not  be  useful.  Rather,  techniques  to  track  deviations 
from  the  forecast  by  comparison  to  regular  technology  data  mining  efforts  might  be  wise,  as 
discussed  earlier. 

We  also  note  the  missed  areas  were  all  stimulated  by  developments  outside  DOD  and  were  more 
in  the  nature  of  very  rapid  technology  exploitation  in  the  marketplace  with  unanticipated 
consequences  for  national  security.  As  DOD  becomes  a  smaller  player  in  the  global  S&T 
enterprise,  such  missed  forecasts  are  increasingly  likely  unless  more  robust  TF  methods  are 
employed  that  involve  broad-based  participation  of  subject  matter  experts  beyond  DOD  and  the 
United  States  and  a  means  to  independently  and  regularly  monitor  the  evolution  of  the  global 
S&T  against  this  forecast.  We  note  that  the  Delphi  survey  method  (#27)  originally  developed  by 
RAND  in  the  1960s51  to  mitigate  issues  of  “groupthink”  and  of  small  number  biases  in  expert 
panels  is  promising  in  the  web-based  context  of  today  because  it  can  readily  scale  to  larger  and 
more  disperse  participation.  Moreover,  broad  survey  participation  stimulates  the  S&T  awareness 
function  of  the  participants.  To  the  extent  that  individual  expert  opinion  iterations  in  the  Delphi 
method  are  also  considered  in  a  “weak  signal”  sense  to  target  technical  data  mining  activities,  the 
overall  process  can  become  more  robust. 


Improving  the  Army ’s  Next  Effort  in  Technology’  Forecasting,  J.  W.  Lyons,  R.  Chait,  and  S.  Erchov  (ed.),  NDU 
Defense  &  Technology  Paper  Number  73  (2010). 

51  See  http://is.niit.edu/pubs/delphibook/. 
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